-- Logs begin at Fri 2022-06-03 11:17:43 UTC, end at Fri 2022-06-03 12:26:33 UTC. -- Jun 03 11:49:42.241332 dv-cinder-844572-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 11:49:42.250148 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 11:49:42 2022] *** Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: nodename: dv-cinder-844572-1-iscsi Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: machine: x86_64 Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: clock source: unix Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: pcre jit disabled Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: detected number of CPU cores: 4 Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: current working directory: / Jun 03 11:49:42.252189 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: detected binary path: /usr/bin/uwsgi-core Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: your processes number limit is 47680 Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: your memory page size is 4096 bytes Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: detected max file descriptor number: 2048 Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: lock engine: pthread robust mutexes Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: thunder lock: enabled Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 11:49:42.252890 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 11:49:42.297472 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: Python main interpreter initialized at 0x55ff3ee669c0 Jun 03 11:49:42.297472 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: python threads support enabled Jun 03 11:49:42.297472 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: your server socket listen backlog is limited to 100 connections Jun 03 11:49:42.297472 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: your mercy for graceful operations on workers is 90 seconds Jun 03 11:49:42.297805 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 11:49:42.297880 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: *** Operational MODE: preforking *** Jun 03 11:49:42.298126 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: *** uWSGI is running in multiple interpreter mode *** Jun 03 11:49:42.298126 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: spawned uWSGI master process (pid: 103022) Jun 03 11:49:42.298302 dv-cinder-844572-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 11:49:42.304681 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: spawned uWSGI worker 1 (pid: 103023, cores: 1) Jun 03 11:49:42.304681 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: spawned uWSGI worker 2 (pid: 103024, cores: 1) Jun 03 11:49:42.304681 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 11:49:43.510625 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 11:49:43.512656 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 11:49:44.225148 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:49:44.225148 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes Jun 03 11:49:44.225495 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:49:44.225495 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes Jun 03 11:49:44.226712 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:49:44.226712 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: from cryptography.utils import int_from_bytes Jun 03 11:49:44.227053 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:49:44.227053 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: from cryptography.utils import int_from_bytes Jun 03 11:49:46.831879 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 11:49:46.832464 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 11:49:46.832652 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 11:49:46.833011 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 11:49:46.833115 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 11:49:46.833465 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 11:49:46.833642 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.833740 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 11:49:46.833968 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.834167 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 11:49:46.834271 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.834535 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 11:49:46.834641 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.834796 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 11:49:46.834909 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.835188 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.835294 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.835531 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.835638 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.835858 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.835951 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.836186 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.836284 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.836446 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.836791 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.836891 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.837118 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-1-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.837357 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.837498 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.837821 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.837912 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.838232 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.838363 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.838572 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.838695 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.838842 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.839007 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.839220 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.839958 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.840080 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-1-iscsi {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.840270 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.840413 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.840729 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.840820 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841231 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841372 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841504 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841628 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841735 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841839 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.841954 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.842139 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.842276 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.842444 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.842763 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.842903 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.843077 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.843225 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.843387 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.843479 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.843725 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.843819 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.844034 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.844143 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.844378 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.844475 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-1-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.844692 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.844790 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845015 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845169 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845331 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845441 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845658 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845746 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.845971 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.846057 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.846337 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.846430 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-1-iscsi {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.846661 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.846828 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.846978 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.847121 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.847290 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.847430 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.847635 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.847739 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.847959 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848115 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848279 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848377 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848600 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848689 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848903 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.848989 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.849212 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.849300 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.849521 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.849615 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.849839 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.849927 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.850145 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.850274 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.850449 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.850537 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.850698 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.850792 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851006 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851110 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851327 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851545 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851673 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851854 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.851997 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.852196 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.852335 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.852476 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.852560 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.852701 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.852788 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853013 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853103 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853337 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853432 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853661 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853760 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.853991 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854091 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854247 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854335 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854505 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854633 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854858 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.854977 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.855184 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.855297 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.855516 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.855626 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.855833 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.855920 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.856145 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.856232 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.856460 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.856547 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.856770 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.856876 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.857080 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.857179 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.857392 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.857517 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.857704 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.857810 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858011 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858127 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858334 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858431 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858654 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858753 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.858965 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.859077 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.859283 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.859388 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.859629 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.859742 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.859939 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860052 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860247 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860355 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860556 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860661 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860876 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.860985 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.861195 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.861299 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.861499 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.861603 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.861749 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.861858 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862051 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862160 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862361 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862473 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862687 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862798 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.862993 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.863095 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.863300 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.863407 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.863632 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.863733 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.863903 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864007 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864209 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864520 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864628 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864823 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.864928 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.865129 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.865228 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.865436 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.865537 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.865737 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.865851 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866038 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866156 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866341 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866458 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866648 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866758 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.866954 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.867060 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.867262 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.867368 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.867593 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.867690 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.867902 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868010 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868208 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868310 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868515 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868616 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868822 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.868930 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.869126 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.869226 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.869433 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.869527 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.869745 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.869850 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870050 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870209 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870365 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870520 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870687 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870847 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.870991 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.871139 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.871290 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.871433 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.871612 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.871773 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.871923 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872066 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872208 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872360 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872503 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872655 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872798 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.872946 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873097 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873240 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873382 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873537 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873681 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873824 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.873972 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.874114 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.874288 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.874444 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.874588 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.874737 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.874881 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.875029 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.875181 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.875324 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.875466 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.875661 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.875825 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876047 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876209 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876373 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876517 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876660 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876802 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.876953 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.877106 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.877251 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.877405 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.877554 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.877704 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.877856 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.878009 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.878161 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.878315 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.878457 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.878607 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.878824 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.878971 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.879115 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.879266 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:49:46.879410 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.879578 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.879748 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.879893 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880034 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880189 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880330 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880481 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880624 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880765 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.880907 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881050 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881193 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881350 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881493 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881644 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881786 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.881936 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.882089 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.882256 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.882408 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.882561 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.882704 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.882866 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883021 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883173 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883325 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883477 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883655 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883806 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.883963 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.884114 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.884267 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.884413 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.884562 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.884706 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.884848 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.885030 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.885189 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.885333 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.885477 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.885654 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.885805 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.886518 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.886634 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.886838 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.886935 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.887153 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.887270 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.887466 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.887574 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.887818 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.887979 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.888151 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.888303 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.888465 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.888615 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.888786 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.888927 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.889099 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.889247 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.889411 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.889692 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.889843 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.889986 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.890129 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.892791 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.892949 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.893109 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.893256 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.893409 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.893563 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.893713 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.893859 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.894001 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.894144 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.894286 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.894286 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.894584 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.894729 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.895296 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.895462 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.895655 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.895655 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.895953 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.896098 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.896248 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.896391 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.896540 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.896788 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.896940 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897082 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897224 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897365 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897528 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897672 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897815 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.897958 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898100 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898250 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898403 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898554 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898697 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898840 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.898995 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.899141 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.899292 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.899455 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.900233 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.900382 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.900527 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.900679 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.900831 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.900975 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.901127 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.901270 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.901412 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.901565 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.902358 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.902520 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.902911 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903059 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903218 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903363 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903533 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903694 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903839 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.903981 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.904137 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.904290 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.904440 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.904585 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.904738 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.904881 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905033 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905176 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905329 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905472 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905615 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905765 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.905988 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.906134 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.906277 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.906420 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.906574 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.906726 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.906962 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.907110 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.907253 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.907404 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.907578 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.907737 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.907882 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908032 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908185 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908335 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908487 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908651 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908795 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.908938 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909081 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909223 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909378 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909523 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909673 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909817 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.909960 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.910114 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.910270 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.910421 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.910583 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.910727 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.910868 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911011 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911162 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911313 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911456 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911637 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911780 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.911923 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912078 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912231 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912386 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912528 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912679 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912834 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.912986 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.913129 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.913278 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.913421 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.913563 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.913714 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.913858 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914007 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914150 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914315 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914459 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914768 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.914919 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915062 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915219 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915373 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915548 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915697 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915842 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.915984 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.916126 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.916297 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.916458 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.916610 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.916762 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.916906 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.917139 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.917323 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.917470 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.917613 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.917756 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.917899 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918048 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918209 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918363 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918519 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918662 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918805 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.918948 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.919099 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.919250 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.919394 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.919586 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.919736 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.919879 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920035 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920178 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920331 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920473 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920622 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920774 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.920917 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921061 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921210 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921359 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921503 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921654 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921804 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.921947 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922091 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922252 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922395 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922551 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922696 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922839 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.922981 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.923124 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.923266 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.923421 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.923586 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.923733 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.923875 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924028 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924172 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924327 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924471 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924623 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924767 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.924909 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925064 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925215 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925361 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925504 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925646 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925795 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.925961 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926105 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926248 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926391 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926534 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926676 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926829 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.926972 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.927133 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.927345 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.927550 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.927702 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.927857 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928012 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928163 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928306 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928450 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928745 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.928887 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929037 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929180 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929331 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929484 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929784 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.929946 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930089 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930231 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930383 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930535 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930678 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930819 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.930968 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.931112 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.931263 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.931408 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.931582 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.931582 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.931870 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.932022 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.932165 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.932307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.932448 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.932614 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.932781 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.933464 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.933611 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.933763 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.933906 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.934048 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.934201 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.934425 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.934582 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.934728 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.934870 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935012 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935161 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935313 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935456 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935635 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935789 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.935933 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936092 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936248 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936390 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936540 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936683 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936827 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.936978 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.937122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.937271 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.937526 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.937675 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.937819 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.937971 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.938122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.938285 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.938430 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.938572 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.938715 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.938868 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939019 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939171 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939315 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939626 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939734 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939820 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939900 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.939987 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940068 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940159 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940240 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940318 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940396 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940473 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940550 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940642 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940743 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940838 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.940927 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941015 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941095 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941186 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941267 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941267 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941487 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941577 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941657 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941741 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941821 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941898 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.941985 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942075 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942156 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942241 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942321 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942398 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942483 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942575 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.942914 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943033 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943222 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943313 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943556 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943663 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943871 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.943961 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.944178 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.944268 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.944498 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.944587 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.944805 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.944894 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.945110 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.945206 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.945415 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.945504 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.945728 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.945837 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946035 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946131 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946341 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946429 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946647 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946745 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.946953 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.947041 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.947268 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.947355 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.947597 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.947705 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.947913 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.948042 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.948220 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.948342 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949085 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949232 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949371 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949501 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949676 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949825 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.949981 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.950122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.950378 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.950535 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.950676 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.950816 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.950919 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951181 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951334 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951490 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951700 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951818 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.951930 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.952119 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.952239 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.952429 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.952599 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.952736 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.952845 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.953082 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.953191 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.953389 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.953486 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.953728 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.953816 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954035 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954120 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954344 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954442 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954652 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954746 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.954964 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.955059 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.955276 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.955365 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.955610 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.955716 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.955920 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956007 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956222 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956311 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956532 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956618 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956837 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.956932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.957142 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.957230 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.957455 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.957540 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.957763 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.957861 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958068 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958156 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958377 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958463 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958684 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958780 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.958986 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.959081 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.959293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.959381 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.959620 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.959721 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.959935 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960028 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960240 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960326 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960545 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960639 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960848 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.960934 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.961159 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.961245 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.961463 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.961557 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.961764 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.961859 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962069 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962163 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962385 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962472 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962691 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962776 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.962993 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.963225 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.963320 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.963399 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.963619 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.963710 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.963929 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.964081 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.964269 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.964419 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.964599 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.964755 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.964900 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965038 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965198 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965342 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965479 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965617 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965791 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.965957 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.966099 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.966242 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.966385 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.966537 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.966686 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.966857 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967144 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967297 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967445 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967631 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967797 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.967954 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968099 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968264 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968413 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968568 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968735 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968846 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.968928 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969041 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969131 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969346 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969438 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969656 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969811 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.969959 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970104 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970264 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970355 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970570 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970666 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970897 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.970993 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.971209 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.971297 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.971535 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.971651 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.971850 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.971942 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.972159 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.972260 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.972471 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.972565 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.972777 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.972878 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.973094 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.973334 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.973422 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.973501 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.973703 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.973800 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974009 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974104 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974317 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974404 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974645 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974746 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.974959 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.975046 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.975266 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.975353 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.975611 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.975712 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.975925 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976012 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976240 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976334 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976544 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976644 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976849 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.976936 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.977157 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.977242 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.977468 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.977556 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.977777 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.977864 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.978087 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.978177 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.978397 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.978485 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.978709 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.978805 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979014 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979101 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979324 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979411 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979657 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979748 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.979996 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.980081 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.980306 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.980393 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.980614 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.980702 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.980918 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981012 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981229 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981334 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981537 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981628 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981842 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.981941 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.982152 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.982239 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.982454 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.982541 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.982763 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.982857 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.983070 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.983196 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.983435 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.983584 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.983805 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.983907 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.984136 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.984303 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.984456 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.984606 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.984858 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985183 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985470 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985618 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985729 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985811 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.985927 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.986070 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.986353 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.986513 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.986676 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.986828 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.986978 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.987126 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.987274 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.987416 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.987624 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.987775 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.987926 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988075 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988224 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988387 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988533 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988680 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988826 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.988970 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.989108 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.989275 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.989433 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.989578 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.989727 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.989878 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990029 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990197 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990351 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990511 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990665 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990813 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.990978 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.991140 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.991285 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.991428 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.991629 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.991753 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.991938 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.992093 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.992263 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.992410 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.992554 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.992700 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.992890 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993035 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993212 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993336 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993518 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993667 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993837 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.993982 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.994122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.994314 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.994427 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.994630 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.994740 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.994962 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.995249 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.995899 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996039 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996165 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996287 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996464 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996624 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996760 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.996884 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.997083 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.997237 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.997405 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.997536 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.997710 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.997848 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998044 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998198 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998356 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998498 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998673 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998828 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.998995 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.999124 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.999295 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.999439 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.999654 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.999807 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:46.999961 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000085 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000227 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000368 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000517 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000664 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000814 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.000985 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.001116 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.001302 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.001459 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.001606 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.001764 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.001942 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.002074 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.002251 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.002406 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.002558 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.002705 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.002863 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003013 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003162 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003320 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003471 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003655 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003796 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.003888 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.004109 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.004198 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.004429 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.004552 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.004748 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.004848 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005065 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005153 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005375 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005474 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005683 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005771 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.005989 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.006077 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.006294 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.006395 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.006619 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.006714 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.006933 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.007020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.007258 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.007354 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.007606 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.007696 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.007920 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008007 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008236 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008372 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008550 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008637 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008858 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.008945 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.009167 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.009268 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.009475 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.009571 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.009805 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.009900 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.010113 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.010202 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.010419 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.010513 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.010728 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.010816 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.011627 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.011817 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.011948 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.012262 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.012401 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.012565 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.012739 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.012880 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.013078 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.013226 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.013403 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.013636 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.013779 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.013936 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.014089 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.014230 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.014380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.014564 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.014717 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.014859 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015000 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015143 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015282 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015435 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015617 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015761 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.015916 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016068 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016223 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016363 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016505 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016648 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016804 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.016942 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017098 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017241 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017399 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017545 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017688 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017832 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.017999 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.018168 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.018315 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.018535 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.018683 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.018830 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.019011 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.019173 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.019333 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.019494 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.019736 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.019904 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020056 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020204 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020368 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020517 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020681 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020845 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.020985 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021075 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021242 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021476 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021645 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.021966 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.022060 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.022286 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.022381 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.022607 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.022696 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.022926 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023013 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023242 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023388 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023580 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023671 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023896 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.023983 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.024208 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.024305 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.024519 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.024614 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.024832 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.024931 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.025149 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.025315 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.025474 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.025691 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.025800 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.026023 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.026120 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.026340 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.026449 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.026687 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.026822 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.027002 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.027141 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.027322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.027457 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.027910 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.028049 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.028234 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.028406 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.028539 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.028720 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.028852 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029030 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029166 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029346 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029496 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029662 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029825 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.029977 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.030259 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.030357 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.030588 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.030824 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.030909 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.030988 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.031198 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.031288 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.031520 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.031610 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.031848 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.031953 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.032163 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.032260 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.032477 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.032565 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.032805 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.032932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.033119 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.033220 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.033439 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.033581 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.033751 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.033840 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034063 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034158 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034377 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034471 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034695 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034896 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.034994 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.035217 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.035306 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.035573 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.035677 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.035903 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.035992 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.036227 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.036316 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.036545 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.036634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.036864 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.036960 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.037187 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.037274 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.037495 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.037590 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.037800 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.037888 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.038113 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.038200 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.038425 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.038633 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.038721 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.038953 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.039042 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.039289 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.039386 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.039647 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.039737 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.039966 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.040052 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.040278 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.040374 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.040600 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.040809 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.040932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.041161 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.041257 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.041480 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.041567 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.041805 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.041893 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.042131 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.042232 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.042471 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.042573 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.042790 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.042878 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.043102 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.043198 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.043411 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.043525 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.043756 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.043884 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.044066 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.044155 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.044378 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.044607 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.044709 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.044978 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.045074 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.045302 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.045457 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.045616 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.045773 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.045912 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046059 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046219 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046371 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046537 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046691 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046836 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.046936 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.047142 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.047230 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.047449 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.047586 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.047769 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.047840 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048081 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048179 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048384 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048476 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048691 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048779 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.048997 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.049093 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.049304 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.049392 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.049611 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.049698 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.049917 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050011 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050223 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050309 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050526 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050613 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050838 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.050932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.051145 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.051241 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.051452 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.051557 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.051793 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.051881 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.052104 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.052204 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.052413 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.052500 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.052721 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.052809 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053028 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053124 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053343 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053430 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053653 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053789 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.053963 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.054059 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.054271 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.054357 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.054594 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.054681 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.054903 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.055000 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.055217 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.055448 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.055592 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.055814 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.055916 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.056142 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.056230 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.056478 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.056566 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.056813 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.056909 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.057126 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.057220 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.057437 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.057532 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.057747 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.058337 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.058593 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.058687 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.058932 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.059019 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.059249 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.059338 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.059594 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.059821 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.059909 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.060163 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.060263 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.060491 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.060579 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.060810 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.060897 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.061122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.061218 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.061433 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.061522 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.061743 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.061830 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062058 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062154 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062356 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062443 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062667 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062754 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.062980 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.063075 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.063297 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.063385 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.063639 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.063729 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.063957 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064088 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064271 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064359 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064590 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064686 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064903 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.064989 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.065214 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.065301 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.065525 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.065664 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.065845 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.065992 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.066156 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.066292 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.066470 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.066639 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.066787 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.066931 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.067080 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.067168 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.067420 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.067529 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.067768 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.067933 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.068090 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.068178 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.068411 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.068507 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.068729 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.068817 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069046 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069146 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069362 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069451 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069671 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.069990 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.070076 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.070301 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.070389 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.070629 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.070715 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.070941 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.071038 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.071282 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.071383 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.071632 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.071724 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.071943 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072045 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072251 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072339 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072557 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072644 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072867 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.072970 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.073189 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.073278 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.074148 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.074251 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.074400 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.074490 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.074708 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.074805 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075019 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075108 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075326 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075415 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075670 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075760 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.075980 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.076080 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.076288 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.076390 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.076600 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.076696 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.076910 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077007 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077218 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077308 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077523 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077612 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077827 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.077924 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.078135 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.078223 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.078441 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.078536 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.078749 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.078845 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079054 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079150 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079361 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079455 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079688 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079790 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.079995 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.080090 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.080298 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.080388 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.080606 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.080701 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.080915 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081003 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081224 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081313 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081532 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081687 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081837 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.081970 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.082147 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.082236 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.082461 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.082551 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.082769 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.082865 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.083076 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.083164 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.083384 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.083472 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.083718 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.083808 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084022 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084117 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084352 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084449 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084752 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.084977 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.085141 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.085288 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.085415 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.085601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.085690 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.085923 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.086086 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.086228 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.086363 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.086558 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.086721 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.086866 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.087039 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.087177 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.087267 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.087560 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.087654 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.087839 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088005 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088156 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088243 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088469 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088556 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088790 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.088886 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.089142 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.089238 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.089458 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.089544 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.089771 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.089860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.090084 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.090179 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.090398 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.090495 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.090715 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.090802 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.091030 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.091117 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.091358 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.091458 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.091709 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.091798 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092032 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092118 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092347 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092451 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092675 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092762 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.092989 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.093076 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.093304 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.093393 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.093625 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.093721 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.093942 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094038 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094258 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094362 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094577 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094674 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094883 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.094971 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.095125 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 11:49:47.095216 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.095546 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.095866 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.096196 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.096527 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.096878 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.097197 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.097544 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.097875 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.098195 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.098510 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.098818 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:49:47.099062 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 11:49:47.153760 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Registered counter for database nova_api Jun 03 11:49:47.158068 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Registered counter for database nova_api Jun 03 11:49:47.175050 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.177520 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.182411 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.185361 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.238613 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.context [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46990915-54e5-4344-a0d3-647f9a9390cf(cell1) {{(pid=103024) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 11:49:47.241140 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.context [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46990915-54e5-4344-a0d3-647f9a9390cf(cell1) {{(pid=103023) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 11:49:47.242749 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:49:47.244355 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:49:47.245144 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:49:47.245261 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:49:47.247363 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:49:47.247688 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:49:47.248204 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:49:47.249693 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Registered counter for database nova_cell0 Jun 03 11:49:47.250177 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:49:47.252208 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Registered counter for database nova_cell0 Jun 03 11:49:47.253776 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Registered counter for database nova_cell1 Jun 03 11:49:47.256194 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Registered counter for database nova_cell1 Jun 03 11:49:47.262237 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.264452 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.265613 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.267821 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.272874 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.273874 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.275446 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.279662 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.422012 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Registered counter for database nova_cell0 Jun 03 11:49:47.430807 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.431298 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Registered counter for database nova_cell0 Jun 03 11:49:47.436083 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.440814 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:49:47.445114 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:49:47.895753 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:49:47.903730 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:49:47.904142 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:49:47.911213 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:49:48.126590 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:49:48.132364 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:49:48.132537 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:49:48.137711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff3ee669c0 pid: 103023 (default app) Jun 03 11:49:48.138253 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-f83c54bf-4f65-4f1c-be5a-89f14081956f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:49:48.140068 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:49:48.141356 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jun 03 11:49:48.141770 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Fri Jun 3 11:49:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:49:48.143276 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff3ee669c0 pid: 103024 (default app) Jun 03 11:51:05.641207 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:05.642783 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Jun 03 11:51:05.648402 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:05.669813 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:05.670799 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:05.671366 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell1:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:05.672128 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:06.095973 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-bb44bfaf-c189-4e67-8070-5e7697c1dda7 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:06.127359 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-bb44bfaf-c189-4e67-8070-5e7697c1dda7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476170 Jun 03 11:51:06.128149 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1291 bytes} [Fri Jun 3 11:51:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:08.420267 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:08.421264 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-466c0f0b-93b7-4ec6-9407-cdbaffeb4d24 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 03 11:51:08.421674 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:08.482743 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-4fc3e336-5ac7-4ed7-931f-575a556810e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:08.501685 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:51:08.501685 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 03 11:51:08.529230 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-4fc3e336-5ac7-4ed7-931f-575a556810e5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101522 Jun 03 11:51:08.529961 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 11:51:08.543432 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:08.544945 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:08.545694 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell1:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:08.546452 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:08.757175 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-51d34b94-ad78-4925-84c8-d008bf434368 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:08.760088 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:51:08.760088 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 03 11:51:08.822707 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-51d34b94-ad78-4925-84c8-d008bf434368 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284809 Jun 03 11:51:08.823484 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1335 bytes} [Fri Jun 3 11:51:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:11.108852 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-4fc3e336-5ac7-4ed7-931f-575a556810e5 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:11.109864 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-4fc3e336-5ac7-4ed7-931f-575a556810e5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 03 11:51:11.110427 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:11.213906 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-fe1a84db-fe7d-4560-b7ba-6c372088585d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:11.231999 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:51:11.231999 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 03 11:51:11.251126 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-fe1a84db-fe7d-4560-b7ba-6c372088585d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135193 Jun 03 11:51:11.251728 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:11.263946 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7b385d9c-776f-431e-b72b-21ffcedde3fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:11.265524 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:51:11.265524 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 03 11:51:11.298010 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7b385d9c-776f-431e-b72b-21ffcedde3fa admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037722 Jun 03 11:51:11.298568 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1335 bytes} [Fri Jun 3 11:51:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:13.591227 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-fe1a84db-fe7d-4560-b7ba-6c372088585d admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:13.592347 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-fe1a84db-fe7d-4560-b7ba-6c372088585d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 03 11:51:13.592915 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:13.656096 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-0b7bb5c2-af84-4d6a-9ab9-5339003c5959 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "id": "d2"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:13.677242 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-0b7bb5c2-af84-4d6a-9ab9-5339003c5959 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078483 Jun 03 11:51:13.678155 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:13.690272 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-a311cdc6-4fa4-4f3b-9280-fcfd262eeb6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:13.719246 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-a311cdc6-4fa4-4f3b-9280-fcfd262eeb6a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032688 Jun 03 11:51:13.720665 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1335 bytes} [Fri Jun 3 11:51:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:16.009470 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-0b7bb5c2-af84-4d6a-9ab9-5339003c5959 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:16.010495 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-0b7bb5c2-af84-4d6a-9ab9-5339003c5959 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 03 11:51:16.010913 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:16.075942 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f9a888d6-af81-4baf-bddd-de1f88523a51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:16.095289 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f9a888d6-af81-4baf-bddd-de1f88523a51 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077927 Jun 03 11:51:16.095885 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:16.107949 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-70013e9e-03be-484a-91fa-0f37b4675195 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:16.132615 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-70013e9e-03be-484a-91fa-0f37b4675195 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028295 Jun 03 11:51:16.134597 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1335 bytes} [Fri Jun 3 11:51:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:18.436977 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f9a888d6-af81-4baf-bddd-de1f88523a51 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:18.437993 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f9a888d6-af81-4baf-bddd-de1f88523a51 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 03 11:51:18.438429 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:18.500785 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-2aa6b703-593d-404b-82c4-235cd70a6c9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:18.518780 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-2aa6b703-593d-404b-82c4-235cd70a6c9e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074316 Jun 03 11:51:18.519340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:18.531783 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-5d52f9ef-abbc-4e76-b5f9-06c413d14808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:18.555336 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-5d52f9ef-abbc-4e76-b5f9-06c413d14808 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027003 Jun 03 11:51:18.556326 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1335 bytes} [Fri Jun 3 11:51:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:20.832300 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-2aa6b703-593d-404b-82c4-235cd70a6c9e admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:20.833309 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-2aa6b703-593d-404b-82c4-235cd70a6c9e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 03 11:51:20.833710 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:20.894168 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ccbad066-32af-4a44-b395-17ef064eab3c admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:20.920921 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ccbad066-32af-4a44-b395-17ef064eab3c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080359 Jun 03 11:51:20.921595 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1291 bytes} [Fri Jun 3 11:51:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:51:23.268385 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-2aa6b703-593d-404b-82c4-235cd70a6c9e admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:23.269405 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-2aa6b703-593d-404b-82c4-235cd70a6c9e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 03 11:51:23.269824 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:23.329928 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-1b0ea6f8-b6ff-4f1c-9d84-a7618522ad5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:23.349065 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-1b0ea6f8-b6ff-4f1c-9d84-a7618522ad5e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073494 Jun 03 11:51:23.349734 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:23.363936 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d6c0154f-2bdd-4441-8bac-83f31a7735f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:23.396096 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d6c0154f-2bdd-4441-8bac-83f31a7735f3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037348 Jun 03 11:51:23.396841 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1332 bytes} [Fri Jun 3 11:51:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:25.672556 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-1b0ea6f8-b6ff-4f1c-9d84-a7618522ad5e admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:25.673573 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-1b0ea6f8-b6ff-4f1c-9d84-a7618522ad5e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 03 11:51:25.674021 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:25.737619 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-8734a6e6-2f14-4d4f-9514-d20c759f37e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:25.754633 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-8734a6e6-2f14-4d4f-9514-d20c759f37e6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074940 Jun 03 11:51:25.755188 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 11:51:25.767515 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-b5c3cd3b-e645-4090-8977-64ea5f610c45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:25.793149 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-b5c3cd3b-e645-4090-8977-64ea5f610c45 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029227 Jun 03 11:51:25.793905 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1332 bytes} [Fri Jun 3 11:51:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:28.090794 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-8734a6e6-2f14-4d4f-9514-d20c759f37e6 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:28.091947 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-8734a6e6-2f14-4d4f-9514-d20c759f37e6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jun 03 11:51:28.092438 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:28.150386 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-3e18a580-5f84-4014-b8aa-e45c696c762b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:28.169561 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-3e18a580-5f84-4014-b8aa-e45c696c762b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071259 Jun 03 11:51:28.171552 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:28.182115 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7216fd37-3819-40a6-9693-836096d564fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:28.204446 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7216fd37-3819-40a6-9693-836096d564fd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026062 Jun 03 11:51:28.205032 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1332 bytes} [Fri Jun 3 11:51:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:30.472940 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-3e18a580-5f84-4014-b8aa-e45c696c762b admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:30.473950 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-3e18a580-5f84-4014-b8aa-e45c696c762b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 03 11:51:30.474612 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:30.534160 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a5cbe5bd-af11-4318-a3c2-be0da1ea7fc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:30.555349 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a5cbe5bd-af11-4318-a3c2-be0da1ea7fc9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074434 Jun 03 11:51:30.556124 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:30.569628 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7e1719f1-2e2f-4aa4-87fa-b18560f168bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:30.597568 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7e1719f1-2e2f-4aa4-87fa-b18560f168bb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033601 Jun 03 11:51:30.598167 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1332 bytes} [Fri Jun 3 11:51:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:51:32.897561 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a5cbe5bd-af11-4318-a3c2-be0da1ea7fc9 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:32.899136 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a5cbe5bd-af11-4318-a3c2-be0da1ea7fc9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Jun 03 11:51:32.899781 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:32.999583 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ac960597-0171-4dd5-b7cc-975904da4f4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:33.034479 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ac960597-0171-4dd5-b7cc-975904da4f4f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.126800 Jun 03 11:51:33.039640 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1282 bytes} [Fri Jun 3 11:51:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:51:33.047335 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-b54fc119-fa2a-4fe4-9864-69585e9a281e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:51:33.070652 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-b54fc119-fa2a-4fe4-9864-69585e9a281e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026911 Jun 03 11:51:33.071222 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1332 bytes} [Fri Jun 3 11:51:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:51:57.506824 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ac960597-0171-4dd5-b7cc-975904da4f4f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:57.507888 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ac960597-0171-4dd5-b7cc-975904da4f4f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 03 11:51:57.508297 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 11:51:57.518815 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:57.567520 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-39f2f573-6671-4981-a705-1c6ab1048c4a admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:57.584659 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-39f2f573-6671-4981-a705-1c6ab1048c4a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069839 Jun 03 11:51:57.585191 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1291 bytes} [Fri Jun 3 11:51:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:51:58.595028 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ac960597-0171-4dd5-b7cc-975904da4f4f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:58.596050 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ac960597-0171-4dd5-b7cc-975904da4f4f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 03 11:51:58.596462 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:58.803719 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-72fe7ff8-a111-4b4b-bb10-a648a7d8dae4 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:58.809405 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-72fe7ff8-a111-4b4b-bb10-a648a7d8dae4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-72fe7ff8-a111-4b4b-bb10-a648a7d8dae4 admin admin] Request method failure captured: Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Host: 10.222.0.15 Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABimfXeFakT7KzbdrtE1rLnLEbTNhN1lnHUnfd8qLBw_eEIDdsSoDrjljLv_IdKi4yoj99Xq4BlrEqJqFVGpcy3EjBGHSdw_vlud5WPr0Bkbwi_KFzjNnozslQ6OJI06gbD7x2UP8IRh6rETtF7vX_yCnUOvsUOEFn5BymZBWTaYOY_r-U Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Role: reader,admin,member Jun 03 11:51:58.812601 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Roles: reader,admin,member Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6db62e59d8164100b9d96eb446461cfc"}]}] Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User: admin Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Id: 0616a4eb01db4ae8ac6d10f710fd1630 Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: method: > Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: exception: Flavor 42 could not be found. Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: action_args: {'id': '42'} Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:51:58.814307 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:51:58.815373 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.817064 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-72fe7ff8-a111-4b4b-bb10-a648a7d8dae4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:51:58.818429 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-72fe7ff8-a111-4b4b-bb10-a648a7d8dae4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061066 Jun 03 11:51:58.818429 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Jun 3 11:51:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:58.823767 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9e5083c7-f6ea-4daf-9e6c-83b9f22d225c admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:58.826691 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:58.846102 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-9e5083c7-f6ea-4daf-9e6c-83b9f22d225c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025862 Jun 03 11:51:58.846647 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Jun 3 11:51:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:51:58.856733 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-416a702d-b846-4db6-8fbb-672c5edd133a admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:58.877940 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-416a702d-b846-4db6-8fbb-672c5edd133a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024749 Jun 03 11:51:58.878470 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Jun 3 11:51:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:51:58.887704 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-db4c4b18-4d06-4f07-8f56-59e684883684 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:58.894246 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-db4c4b18-4d06-4f07-8f56-59e684883684 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-db4c4b18-4d06-4f07-8f56-59e684883684 admin admin] Request method failure captured: Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Accept: application/json Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Connection: keep-alive Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Content-Length: 0 Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Host: 10.222.0.15 Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABimfXeFakT7KzbdrtE1rLnLEbTNhN1lnHUnfd8qLBw_eEIDdsSoDrjljLv_IdKi4yoj99Xq4BlrEqJqFVGpcy3EjBGHSdw_vlud5WPr0Bkbwi_KFzjNnozslQ6OJI06gbD7x2UP8IRh6rETtF7vX_yCnUOvsUOEFn5BymZBWTaYOY_r-U Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Domain-Id: None Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Domain-Name: None Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Name: admin Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Role: reader,admin,member Jun 03 11:51:58.898020 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Roles: reader,admin,member Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6db62e59d8164100b9d96eb446461cfc"}]}] Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant: admin Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User: admin Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Id: 0616a4eb01db4ae8ac6d10f710fd1630 Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Name: admin Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: method: > Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: exception: Flavor 42 could not be found. Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: action_args: {'id': '42'} Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:51:58.899465 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:51:58.900322 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:58.901634 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-db4c4b18-4d06-4f07-8f56-59e684883684 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:51:58.903184 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-db4c4b18-4d06-4f07-8f56-59e684883684 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015514 Jun 03 11:51:58.903184 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Jun 3 11:51:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 11:51:59.753960 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-416a702d-b846-4db6-8fbb-672c5edd133a admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:59.754980 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-416a702d-b846-4db6-8fbb-672c5edd133a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 03 11:51:59.755376 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:51:59.943876 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-75859f10-1a52-4b89-b4fc-456c6b382a87 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:59.949139 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-75859f10-1a52-4b89-b4fc-456c6b382a87 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-75859f10-1a52-4b89-b4fc-456c6b382a87 admin admin] Request method failure captured: Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Accept: application/json Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Connection: keep-alive Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Content-Length: 0 Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Host: 10.222.0.15 Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABimfXfvted1DUVC2CF9lrsnBoysCm0WEHWD-FJd91HgrbLzPBccCbN_DG17kCZGVW-Zs1qXjDMGQ_C_ykX9UlIdbuVZlazM4XzqchPSftMqFw4dNp0aRWhbh6nhtIniW-ZfrJ2fMNdEytsnhk45oS0VtEsbsZkN1Mc-eSqKVVR0hbaawk Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Domain-Id: None Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Domain-Name: None Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Name: admin Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Role: reader,admin,member Jun 03 11:51:59.950711 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Roles: reader,admin,member Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6db62e59d8164100b9d96eb446461cfc"}]}] Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant: admin Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User: admin Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Id: 0616a4eb01db4ae8ac6d10f710fd1630 Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Name: admin Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: method: > Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: exception: Flavor 84 could not be found. Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: action_args: {'id': '84'} Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:51:59.952298 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:51:59.953154 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:51:59.954296 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-75859f10-1a52-4b89-b4fc-456c6b382a87 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:51:59.955567 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-75859f10-1a52-4b89-b4fc-456c6b382a87 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061036 Jun 03 11:51:59.955567 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Jun 3 11:51:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:59.962214 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-9ba49f35-88f1-450f-89d5-683bd8e7e15b admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:51:59.978147 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-9ba49f35-88f1-450f-89d5-683bd8e7e15b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019998 Jun 03 11:51:59.978668 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Jun 3 11:51:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:51:59.987923 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-dfb018a1-6b9f-420e-84b0-453e1b486d63 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:00.001156 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-dfb018a1-6b9f-420e-84b0-453e1b486d63 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016795 Jun 03 11:52:00.001836 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Jun 3 11:51:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:52:00.011030 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-57f7ad1d-4def-4da9-bbc5-5d5626858be2 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:00.016361 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-57f7ad1d-4def-4da9-bbc5-5d5626858be2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-57f7ad1d-4def-4da9-bbc5-5d5626858be2 admin admin] Request method failure captured: Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Host: 10.222.0.15 Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABimfXfvted1DUVC2CF9lrsnBoysCm0WEHWD-FJd91HgrbLzPBccCbN_DG17kCZGVW-Zs1qXjDMGQ_C_ykX9UlIdbuVZlazM4XzqchPSftMqFw4dNp0aRWhbh6nhtIniW-ZfrJ2fMNdEytsnhk45oS0VtEsbsZkN1Mc-eSqKVVR0hbaawk Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Role: reader,admin,member Jun 03 11:52:00.017860 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Roles: reader,admin,member Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6db62e59d8164100b9d96eb446461cfc"}]}] Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User: admin Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Id: 0616a4eb01db4ae8ac6d10f710fd1630 Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: method: > Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: exception: Flavor 84 could not be found. Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: action_args: {'id': '84'} Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:52:00.019340 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:52:00.020409 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:00.022401 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-57f7ad1d-4def-4da9-bbc5-5d5626858be2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:52:00.023692 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-57f7ad1d-4def-4da9-bbc5-5d5626858be2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011653 Jun 03 11:52:00.023692 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Jun 3 11:52:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:00.892364 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-dfb018a1-6b9f-420e-84b0-453e1b486d63 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:00.893373 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-dfb018a1-6b9f-420e-84b0-453e1b486d63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 03 11:52:00.893797 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:52:01.083694 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1059866e-bd47-43e9-a337-1b58dec1bb93 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:01.089508 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-1059866e-bd47-43e9-a337-1b58dec1bb93 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1059866e-bd47-43e9-a337-1b58dec1bb93 admin admin] Request method failure captured: Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Host: 10.222.0.15 Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABimfXgkUbYsp17tVly3AlXSEXV17-X8KoevTRl1eXtONLsWpvCWquPX9JGMd2ze7M0sDkZJt2MhvZcNJINrnaJTsF37YrSlkcA0JA9qaH1apIVa6cM-D91hhjWPxOHIkjw8ZuRtlOUWvtzjkAm0b0Wip5ciGJdE-4hwDorAnbd7G2X1eE Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Role: reader,admin,member Jun 03 11:52:01.091001 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Roles: reader,admin,member Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6db62e59d8164100b9d96eb446461cfc"}]}] Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User: admin Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Id: 0616a4eb01db4ae8ac6d10f710fd1630 Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: method: > Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: exception: Flavor 451 could not be found. Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: action_args: {'id': '451'} Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:52:01.092664 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:52:01.093622 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.095122 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1059866e-bd47-43e9-a337-1b58dec1bb93 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:52:01.096422 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-1059866e-bd47-43e9-a337-1b58dec1bb93 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061897 Jun 03 11:52:01.096422 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Jun 3 11:52:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:01.102698 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-fd51bc7f-f193-4859-8d4d-d09faccca229 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:01.117039 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-fd51bc7f-f193-4859-8d4d-d09faccca229 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018549 Jun 03 11:52:01.117608 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Jun 3 11:52:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:52:01.131608 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:01.147836 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021440 Jun 03 11:52:01.148371 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Jun 3 11:52:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:52:01.157832 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-8badb2dc-6b50-457b-b2e9-a0c45ddc2fb2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:01.163780 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-8badb2dc-6b50-457b-b2e9-a0c45ddc2fb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-8badb2dc-6b50-457b-b2e9-a0c45ddc2fb2 admin admin] Request method failure captured: Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Accept: application/json Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Connection: keep-alive Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Content-Length: 0 Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Host: 10.222.0.15 Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABimfXgkUbYsp17tVly3AlXSEXV17-X8KoevTRl1eXtONLsWpvCWquPX9JGMd2ze7M0sDkZJt2MhvZcNJINrnaJTsF37YrSlkcA0JA9qaH1apIVa6cM-D91hhjWPxOHIkjw8ZuRtlOUWvtzjkAm0b0Wip5ciGJdE-4hwDorAnbd7G2X1eE Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Domain-Id: None Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Domain-Name: None Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Project-Name: admin Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Role: reader,admin,member Jun 03 11:52:01.165293 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Roles: reader,admin,member Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6db62e59d8164100b9d96eb446461cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6db62e59d8164100b9d96eb446461cfc"}]}] Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant: admin Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 6db62e59d8164100b9d96eb446461cfc Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User: admin Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Id: 0616a4eb01db4ae8ac6d10f710fd1630 Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: X-User-Name: admin Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: method: > Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: exception: Flavor 451 could not be found. Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: action_args: {'id': '451'} Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:52:01.166757 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:52:01.167932 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 03 11:52:01.169380 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-8badb2dc-6b50-457b-b2e9-a0c45ddc2fb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:52:01.170645 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-8badb2dc-6b50-457b-b2e9-a0c45ddc2fb2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012372 Jun 03 11:52:01.170645 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Jun 3 11:52:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:02.026713 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:02.027756 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jun 03 11:52:02.028152 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:52:02.215008 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ce528730-c13e-4308-8742-17ab2ce3b5a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:52:02.231998 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ce528730-c13e-4308-8742-17ab2ce3b5a2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068692 Jun 03 11:52:02.232534 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Jun 3 11:52:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:52:03.085621 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:03.086636 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 03 11:52:03.087069 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:52:03.275345 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-4a7d053c-5273-42cf-9b20-df767921a936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:52:03.292457 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-4a7d053c-5273-42cf-9b20-df767921a936 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069001 Jun 03 11:52:03.293006 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Jun 3 11:52:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:52:04.166510 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:04.167584 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 03 11:52:04.167988 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:52:04.353746 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ed3b0834-6f9e-42c7-ab8d-44dc4eb89be4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:52:04.370335 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ed3b0834-6f9e-42c7-ab8d-44dc4eb89be4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067678 Jun 03 11:52:04.370878 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Jun 3 11:52:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:52:05.223750 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:05.224805 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 03 11:52:05.225208 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:52:05.412986 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c2a09b49-538e-4c4c-9460-3969e89f2924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:52:05.431186 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c2a09b49-538e-4c4c-9460-3969e89f2924 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069704 Jun 03 11:52:05.431755 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Jun 3 11:52:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 11:52:06.293746 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:06.294780 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 03 11:52:06.295204 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:52:06.481624 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-1459de0b-aa10-4bcc-93e6-8c4750465735 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:52:06.500892 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-1459de0b-aa10-4bcc-93e6-8c4750465735 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069872 Jun 03 11:52:06.501428 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Fri Jun 3 11:52:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:53:07.276256 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:53:07.277291 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-92906e74-de9d-47e7-8445-55c1b18e6fd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 03 11:53:07.277685 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 930 bytes} [Fri Jun 3 11:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:53:07.289253 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:53:07.338229 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-1ea4bd34-6cd8-4d73-afdd-eced61ae7a96 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:53:07.358003 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-1ea4bd34-6cd8-4d73-afdd-eced61ae7a96 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074455 Jun 03 11:53:07.358556 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1291 bytes} [Fri Jun 3 11:53:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:53:07.379106 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=14 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:53:07.383079 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-bf77aa31-2702-4253-bdf0-a5d8bb03c061 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:53:07.390737 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-bf77aa31-2702-4253-bdf0-a5d8bb03c061 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013059 Jun 03 11:53:07.391248 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1282 bytes} [Fri Jun 3 11:53:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:53:07.403203 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c13a08ac-4b04-4174-afdf-945044b03591 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:53:07.411286 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c13a08ac-4b04-4174-afdf-945044b03591 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011835 Jun 03 11:53:07.411833 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1285 bytes} [Fri Jun 3 11:53:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:53:07.422507 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:53:07.430027 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010885 Jun 03 11:53:07.430546 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1285 bytes} [Fri Jun 3 11:53:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:53:07.441387 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-57a2abfa-5cb7-4657-8fac-1018b98d477e admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:53:07.448837 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-57a2abfa-5cb7-4657-8fac-1018b98d477e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010795 Jun 03 11:53:07.449349 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1282 bytes} [Fri Jun 3 11:53:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:56:27.756916 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:27.757929 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 03 11:56:27.758331 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:56:27.911038 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=6 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:28.023818 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f02b2a8e-41fc-4090-98f5-9b64439ca3c4 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:28.025008 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:56:28.025008 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 03 11:56:28.026213 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-f02b2a8e-41fc-4090-98f5-9b64439ca3c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:28.026681 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-f02b2a8e-41fc-4090-98f5-9b64439ca3c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:28.027491 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-f02b2a8e-41fc-4090-98f5-9b64439ca3c4 admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:28.027938 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-f02b2a8e-41fc-4090-98f5-9b64439ca3c4 admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:28.061842 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f02b2a8e-41fc-4090-98f5-9b64439ca3c4 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152193 Jun 03 11:56:28.062396 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Jun 3 11:56:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:56:28.923446 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:28.924527 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 03 11:56:28.924926 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:56:29.114503 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-a78a4f6a-9646-4999-a3f3-f27bba0de2ae admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:29.115691 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:56:29.115691 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 03 11:56:29.116908 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-a78a4f6a-9646-4999-a3f3-f27bba0de2ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:29.117344 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-a78a4f6a-9646-4999-a3f3-f27bba0de2ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:29.118133 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-a78a4f6a-9646-4999-a3f3-f27bba0de2ae admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:29.118788 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-a78a4f6a-9646-4999-a3f3-f27bba0de2ae admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:29.142347 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-a78a4f6a-9646-4999-a3f3-f27bba0de2ae admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078889 Jun 03 11:56:29.143082 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Jun 3 11:56:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:56:40.412962 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:40.413961 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 03 11:56:40.414357 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:56:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:56:40.555705 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=4 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:40.556421 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell1:SELECT=4 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:40.557076 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=8 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:40.605346 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-94a7d356-a209-4ac3-93e3-37f3828eae24 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:40.606497 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:56:40.606497 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 03 11:56:40.607717 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-94a7d356-a209-4ac3-93e3-37f3828eae24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:40.608167 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-94a7d356-a209-4ac3-93e3-37f3828eae24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:40.608949 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-94a7d356-a209-4ac3-93e3-37f3828eae24 admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:40.609385 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-94a7d356-a209-4ac3-93e3-37f3828eae24 admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:40.633873 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-94a7d356-a209-4ac3-93e3-37f3828eae24 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082574 Jun 03 11:56:40.634355 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Jun 3 11:56:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:56:41.498382 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:41.499482 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-71a42099-d0a8-4526-ba12-0be447d8a0b8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jun 03 11:56:41.500422 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Jun 3 11:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:56:41.688973 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-bb672ca7-c1a6-4128-9071-d057b61b1c07 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:56:41.690130 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:56:41.690130 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 03 11:56:41.691314 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-bb672ca7-c1a6-4128-9071-d057b61b1c07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:41.691799 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-bb672ca7-c1a6-4128-9071-d057b61b1c07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:41.692583 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-bb672ca7-c1a6-4128-9071-d057b61b1c07 admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:56:41.693014 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-bb672ca7-c1a6-4128-9071-d057b61b1c07 admin admin] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:56:41.714223 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-bb672ca7-c1a6-4128-9071-d057b61b1c07 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076065 Jun 03 11:56:41.714695 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Jun 3 11:56:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:57:38.820796 dv-cinder-844572-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 11:57:38.821329 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: Fri Jun 3 11:57:38 2022 - graceful shutdown triggered... Jun 03 11:57:38.821809 dv-cinder-844572-1-iscsi devstack@n-api.service[103024]: Gracefully killing worker 2 (pid: 103024)... Jun 03 11:57:38.822196 dv-cinder-844572-1-iscsi devstack@n-api.service[103023]: Gracefully killing worker 1 (pid: 103023)... Jun 03 11:57:39.822116 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: worker 1 buried after 1 seconds Jun 03 11:57:39.822116 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: worker 2 buried after 1 seconds Jun 03 11:57:39.822671 dv-cinder-844572-1-iscsi devstack@n-api.service[103022]: goodbye to uWSGI. Jun 03 11:57:39.823624 dv-cinder-844572-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 11:57:39.824174 dv-cinder-844572-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 11:57:39.826863 dv-cinder-844572-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 11:57:39.840419 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 11:57:39 2022] *** Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: nodename: dv-cinder-844572-1-iscsi Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: machine: x86_64 Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: clock source: unix Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: pcre jit disabled Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: detected number of CPU cores: 4 Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: current working directory: / Jun 03 11:57:39.857092 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: detected binary path: /usr/bin/uwsgi-core Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: your processes number limit is 47680 Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: your memory page size is 4096 bytes Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: detected max file descriptor number: 2048 Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: lock engine: pthread robust mutexes Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: thunder lock: enabled Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 11:57:39.857879 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 11:57:39.903117 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: Python main interpreter initialized at 0x560c3b2329c0 Jun 03 11:57:39.903117 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: python threads support enabled Jun 03 11:57:39.903117 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: your server socket listen backlog is limited to 100 connections Jun 03 11:57:39.903117 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: your mercy for graceful operations on workers is 90 seconds Jun 03 11:57:39.903492 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 11:57:39.903600 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: *** Operational MODE: preforking *** Jun 03 11:57:39.903862 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: *** uWSGI is running in multiple interpreter mode *** Jun 03 11:57:39.903862 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: spawned uWSGI master process (pid: 117606) Jun 03 11:57:39.904062 dv-cinder-844572-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 11:57:39.905262 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: spawned uWSGI worker 1 (pid: 117617, cores: 1) Jun 03 11:57:39.905262 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: spawned uWSGI worker 2 (pid: 117618, cores: 1) Jun 03 11:57:39.905262 dv-cinder-844572-1-iscsi devstack@n-api.service[117606]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 11:57:41.134204 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 11:57:41.134770 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 11:57:41.967207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:57:41.967207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: from cryptography.utils import int_from_bytes Jun 03 11:57:41.967562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:57:41.967562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: from cryptography.utils import int_from_bytes Jun 03 11:57:41.967562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:57:41.967562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: from cryptography.utils import int_from_bytes Jun 03 11:57:41.967950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:57:41.967950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: from cryptography.utils import int_from_bytes Jun 03 11:57:44.325852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 11:57:44.326549 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 11:57:44.326664 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 11:57:44.326984 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 11:57:44.327247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 11:57:44.327673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.328007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.328243 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 11:57:44.328624 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.328725 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 11:57:44.328820 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.328980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.329083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 11:57:44.329300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.329407 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 11:57:44.329631 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.329724 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 11:57:44.329961 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330297 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330401 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330888 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.330995 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.331221 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-1-iscsi {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.331328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.331574 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.331672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.331892 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332345 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332531 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332691 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.332944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.333164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.333263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.333478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.333575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-1-iscsi {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.333826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.333985 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.334126 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335113 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335759 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.335916 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.336150 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.336256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.336377 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.336510 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.336766 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.337029 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.337244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.337486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.337707 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.337951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.338203 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-1-iscsi {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.338436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.338659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.338871 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.339115 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.339344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.339577 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.339826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.339826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.340224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.340413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.340620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.340620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.340920 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-1-iscsi {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.341123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.341286 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.341453 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.341609 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.341796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.341968 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.342115 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.342262 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.342423 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.342580 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.342727 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.342918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.343109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.343271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.343433 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.343629 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.343787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.343976 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.344128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.344281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.344443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.344617 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.345016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.345177 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.345326 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.345481 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.345629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.345861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.346992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.347146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.347300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.347300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.347632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.347632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348195 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348509 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348821 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.348969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.349116 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.349277 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.349433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.349581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.349746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.349917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.350083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.350293 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.350447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.350595 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.350742 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.350914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.351075 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.351222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.351369 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.351542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.351707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.351869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.352026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.352173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.352364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.352516 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.352671 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.352902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353061 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353509 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353827 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.353975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.354121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.354275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.354464 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.354624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.355482 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.355668 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.355824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.355971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.356117 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.356272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.356453 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.356609 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.356758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.356905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357525 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357681 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.357983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.358138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.358285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.358488 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.358651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.358800 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.358946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.359107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.359260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.359414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.359599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.359768 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.359924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.360104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.360316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.360466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.360623 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.360777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.360941 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.361090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.361244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.361405 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.361560 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.361714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.361871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.362026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.362181 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.362334 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.362489 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.362691 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.362854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363156 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363310 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363817 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.363975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.364122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.364268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.364421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.364575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.364749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.364904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.365059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.365231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.365483 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.365645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.365793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.365939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.366102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.366250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.366404 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.366732 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.366901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.367058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.367221 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.367369 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.367534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.367705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.367854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368009 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368319 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368473 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.368942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.369095 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.369244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.369390 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.369550 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.369698 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.369854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.370007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.370154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.370908 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.371082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.371239 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.371394 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.371584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.371737 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.371902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372203 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372505 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372651 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372805 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.372953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.373098 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.373251 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.373399 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.373564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.373724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.373877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374323 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374639 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374788 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.374940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.375095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.375248 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.375412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.375412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.375757 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.375914 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.376069 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.376215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.376370 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.376520 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:57:44.376677 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.376824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.376977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.377130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.377290 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.377455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.377604 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.377757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.377903 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378494 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378802 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.378991 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.379144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.379300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.379452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.379623 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.379771 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.379771 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.380062 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.380220 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.380378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.380612 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.380762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.380908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.381991 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.382138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.382292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.382438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.382584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.382746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.382902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.383058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.383213 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.383369 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.383573 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.383740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.383898 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384052 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384353 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384507 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384663 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384811 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.384966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.385112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.385282 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.385436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.385597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.385754 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.385903 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.386549 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.386696 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.386857 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387843 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.387999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.388154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.388154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.388431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.388577 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.388736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.388883 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389328 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389474 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389633 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389798 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.389944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390246 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.390832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.391114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.391114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.391417 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.391608 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.391772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.391919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392065 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392220 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392662 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.392971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.393133 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.393288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.393498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.393647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.393811 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.393967 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.394123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.394365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.394525 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.394671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.394828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.394984 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395177 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395332 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.395961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.396249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.396406 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.396553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.396713 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.396874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.397022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.397175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.397322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.397469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.397628 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398357 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398505 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.398958 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.399111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.399260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.399414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.399603 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.399769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.399917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400073 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400227 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400528 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400689 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400835 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.400992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.401147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.401294 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.401439 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.402180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.402352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.402510 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.402656 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.402804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.402965 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.403120 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.403308 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.403467 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.403650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.403800 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.403956 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.404112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.404266 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.404413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.404569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.404724 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.404883 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405349 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405504 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405504 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.405954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.406109 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.406256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.406411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.406411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.406717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.406865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.407012 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.407166 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.407320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.407486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.407700 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.407856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408168 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408784 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.408938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.409086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.409239 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.409397 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.409554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.409701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.409856 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410229 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410386 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410689 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410835 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.410989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.411151 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.411306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.411453 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.411628 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.411775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.411932 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.412094 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.412249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.412404 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.412564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.412725 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.412887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413369 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413524 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413670 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.413972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.414119 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.414274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.414428 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.414585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.414747 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.414902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.415050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.415204 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.415364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.415550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.415723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.415879 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416034 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416190 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416338 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416485 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.416966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.417113 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.417267 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.417416 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.417572 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.417725 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.417885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418509 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418680 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418835 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.418987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.419139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.419341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.419531 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.419693 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.419857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420171 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.420978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.421131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.421296 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.421450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.421603 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.421762 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.421922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.422090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.422251 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.422412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.422566 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.422719 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.422881 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.423043 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.423205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.423366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.423551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.423713 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.423866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424031 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424185 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424345 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424649 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424819 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.424986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.425154 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.425318 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.425479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.425633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.425800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.425955 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.426116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.426270 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.426432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.426593 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.426755 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.426921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.427080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.427234 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.427387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.427567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.427741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.427904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.428065 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.428226 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.428386 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.428557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.428724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.428888 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.429054 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.429206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.429365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.429518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.429684 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.429845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430168 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430791 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.430943 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.431107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.431268 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.431430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.431641 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.431797 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.431949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.432113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.432274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.432437 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.432590 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.432742 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.432895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.433065 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.433228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.433391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.433545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.433698 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.433850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434011 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434180 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434334 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434493 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434654 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.434968 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.435147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.435320 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.435526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.435698 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.435852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436016 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436182 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436338 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436499 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436653 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436806 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.436966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.437128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.437295 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.437447 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.437599 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.437760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.437924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.438079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.438250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.438250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.438607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.438769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.438936 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439110 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439265 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439693 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439988 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.439988 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.440279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.440421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.440593 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.440738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.440879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441001 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441242 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441357 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.441882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442600 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442813 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.442930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443064 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443549 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.443926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444786 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.444910 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445024 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445135 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445623 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.445896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446035 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446461 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.446959 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.447093 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.447225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.447363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.447532 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.447693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.447945 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.448068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.448181 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.448308 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.448946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449417 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.449965 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450253 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450523 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.450883 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451018 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.451911 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452045 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452188 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452330 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452473 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452649 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452792 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.452927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.453186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.453331 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.453465 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.453605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.453780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.453921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454052 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454192 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454454 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.454894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455028 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455161 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455297 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.455890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456022 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456155 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456295 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.456881 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457024 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457308 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457720 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457860 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.457994 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458407 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.458997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459274 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.459973 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460103 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460505 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.460923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461090 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461225 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461367 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461502 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.461916 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462056 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462341 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462483 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462623 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462763 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.462896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463038 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463471 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463654 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463795 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.463938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.464676 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.464829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.464963 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465095 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465242 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465523 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465667 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.465942 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466088 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466495 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466769 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.466916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.467050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.467213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.467346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.467478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.468172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.468329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.468464 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.468596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.468729 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.468863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469010 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469407 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469539 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469679 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469823 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.469964 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470229 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470501 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470649 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.470917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471181 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471524 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.471927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.472889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473034 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473167 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473299 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473430 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473844 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.473985 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474127 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474268 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474813 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.474946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475388 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475829 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.475970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.476113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.476331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.476474 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.476607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.476739 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.476879 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477013 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477155 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477296 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477560 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477698 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.477971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.478104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.478238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.478377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.478517 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.478658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.478800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.479220 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.479394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.479576 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.479748 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.479898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480032 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480165 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480717 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.480991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481267 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481400 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481542 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481676 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.481949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482081 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482769 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.482909 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483190 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483462 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483609 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.483897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484302 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.484866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485000 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.485972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486255 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486536 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486678 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486817 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.486957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.487104 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.487237 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.487369 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.487569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.487717 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.487905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488599 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488782 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.488939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.489082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.489223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.489406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.489557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.489724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.489862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.490057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.490205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.490377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.490526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.490694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.490839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491020 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491492 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.491998 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.492142 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.492312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.492449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.492644 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.492781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.492975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.493118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.493298 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.493443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.493618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.493754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.493930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.494075 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.494227 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.494368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.494558 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.494695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.494869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.495017 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.495188 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.495347 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.495555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.495709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.495871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.496022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.496181 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.496318 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.496490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.496627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.496821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497037 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497180 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497321 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.497901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.498070 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.498216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.498386 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.498530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.498696 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.498841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499004 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499328 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499470 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.499971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.500115 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.500282 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.500427 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.500615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.500761 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.500932 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.501075 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.501242 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.501379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.501570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.501708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.501887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502355 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502639 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.502944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.503157 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.503310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.503470 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.503665 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.503813 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.503947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.504122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.504268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.504432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.504571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.504748 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.504885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.505998 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.506135 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.506307 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.506454 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.506616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.506753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.506924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.507062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.507252 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.507386 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508806 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.508946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509221 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509354 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.509906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510046 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510309 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510448 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510580 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510727 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.510861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.511572 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.511738 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.511886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512162 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.512977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513501 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513646 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.513951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.514096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.514272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.514417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.514604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.514750 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.514937 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.515082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.515261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.515398 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.515605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.515751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.515928 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.516173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.516319 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.516512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.516663 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.516836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.516973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.517159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.517307 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.517478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.517614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.517866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.518010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.518152 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.518285 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.518431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.518694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.518838 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519345 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519491 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.519993 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.520131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.520368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.520520 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.520636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.520770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.520935 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.521059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.521292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.521452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.521613 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.521913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.522051 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.522238 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.522391 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.522581 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.522965 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.523144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.523281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.523467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.523627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.523816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.523968 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.524142 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.524279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.524461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.524607 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.524779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.524916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.525100 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.525245 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.525421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.525559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.525739 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.525884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.526057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.526203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.526379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.526541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.527231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.527371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.527585 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.527846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528141 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528427 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528576 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.528883 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.529018 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.529157 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.529290 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.529432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.529685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.529821 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.530013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.530160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.530356 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.530502 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.530690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.530829 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531325 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.531997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.532140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.532309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.532526 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.532663 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.532848 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.532986 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.533191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.533342 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.533524 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.533660 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.533855 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.533990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.534175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.534326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.534487 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.534624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.534815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.534944 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.535151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.535298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.535439 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.535705 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.535843 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.536066 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.536216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.536384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.536527 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.536718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.536861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537035 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537493 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.537979 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.538125 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.538291 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.538522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.538659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.538882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.539983 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.540151 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.540288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.540467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.540604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.540779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.540925 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.541099 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.541244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.541412 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.541557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.541731 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.541876 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.542047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.542204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.542385 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.542527 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.542696 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.542832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543012 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543156 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.543961 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.544096 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.544272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.544408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.544589 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.544725 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.544901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545046 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545359 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.545983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.546149 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.546293 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.546459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.546596 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.546772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.546909 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.547085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.547223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.547405 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.547617 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.547777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.547953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548097 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548229 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548362 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548495 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.548938 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.549085 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.549256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.549393 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.549614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.549751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.549945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.550094 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.550257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.550487 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.550625 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.550834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.550980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.551166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.551303 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.551590 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.551731 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.551864 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552010 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552145 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.552935 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.553124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.553333 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.553470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.553679 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.553830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554353 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554498 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554815 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.554988 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.555126 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.555305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.555441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.555630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.555814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.555957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.556089 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.556253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.556390 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.556571 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.556709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.556887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.557022 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.557202 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.557337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.557549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.557683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.558333 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.558470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.558649 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.558800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.558949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.559097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.559271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.559408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.559616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.559769 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.559936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.560083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.560253 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.560389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.560570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.560717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.560884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561028 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.561997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.562175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.562311 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.562497 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.562642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.562814 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.562951 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.563129 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.563266 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.563445 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.563615 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.563780 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.563922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.564092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.564230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.564429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.564568 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.564748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.564886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.565064 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.565201 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.565427 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.565563 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.565767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.565904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.566106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.566252 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.566434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.566570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.566751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.566895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.567064 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.567213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.567376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.567554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.567714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.567850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568034 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568184 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568801 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.568977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.569122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.569289 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.569436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.569606 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.569751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.569918 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570064 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.570987 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.571166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.571310 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.571476 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.571648 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.571816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.571948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.572102 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.572241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.572408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.572557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.572716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.572857 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.573024 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.573160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.573332 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.574939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.575105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.575250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.575413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.575570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.575747 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.575885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.576056 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.576193 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.576367 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.576502 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.576681 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.576866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577009 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577143 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577274 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577583 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577720 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.577894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.578032 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.578201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.578337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.578538 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.578676 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.578877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.579022 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.579198 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.579346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.579556 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.579707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.579880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580303 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580613 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.580936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.581110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.581256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.581429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.581564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.581746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.581883 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.582085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.582231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.582402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.582548 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.582719 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.582867 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583038 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.583997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.584145 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.584331 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.584476 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.584646 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.584783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.584970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.585108 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.585287 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.585430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.585605 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.585757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.585928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.586072 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.586250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.586384 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.586566 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.586718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.586905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.587041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.587222 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.587359 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.587557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.587779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.587916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588354 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588503 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588799 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.588936 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.589147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.589284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.589484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.589629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.589817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.589954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.590136 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.590281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.590428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 11:57:44.590570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.590787 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.591142 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.591464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.591842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.592181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.592505 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.592827 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.593139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:57:44.593390 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 11:57:44.651006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO dbcounter [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Registered counter for database nova_api Jun 03 11:57:44.654103 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Registered counter for database nova_api Jun 03 11:57:44.670909 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_db.sqlalchemy.engines [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.673277 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.678708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writer thread running {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.680254 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.736674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.context [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46990915-54e5-4344-a0d3-647f9a9390cf(cell1) {{(pid=117617) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 11:57:44.737890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.context [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),46990915-54e5-4344-a0d3-647f9a9390cf(cell1) {{(pid=117618) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 11:57:44.740859 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:57:44.741972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:57:44.742388 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:57:44.743201 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:57:44.743598 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:57:44.744409 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:57:44.745215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:57:44.746930 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:57:44.747731 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO dbcounter [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Registered counter for database nova_cell0 Jun 03 11:57:44.748931 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Registered counter for database nova_cell0 Jun 03 11:57:44.751771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO dbcounter [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Registered counter for database nova_cell1 Jun 03 11:57:44.752949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Registered counter for database nova_cell1 Jun 03 11:57:44.759624 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_db.sqlalchemy.engines [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.761804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_db.sqlalchemy.engines [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.764201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.765685 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.767255 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writer thread running {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.773657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.774000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.913625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writer thread running {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.922779 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Registered counter for database nova_cell0 Jun 03 11:57:44.924173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO dbcounter [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Registered counter for database nova_cell0 Jun 03 11:57:44.930259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.932486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_db.sqlalchemy.engines [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:57:44.935644 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:44.937912 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writer thread running {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:57:45.371085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:57:45.372801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: WARNING keystonemiddleware.auth_token [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:57:45.378465 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:57:45.380157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: WARNING keystonemiddleware.auth_token [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:57:45.602953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:57:45.607807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: WARNING keystonemiddleware.auth_token [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 11:57:45.609557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-baa7f916-169f-4d66-82b1-3d5dde6b9c1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:57:45.613797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: WARNING keystonemiddleware.auth_token [None req-362b982f-07ae-4a8f-9b7a-0ba70ac25037 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 11:57:45.614841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c3b2329c0 pid: 117618 (default app) Jun 03 11:57:45.618876 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c3b2329c0 pid: 117617 (default app) Jun 03 11:58:26.603923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.605023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.605973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.606723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.864844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.865663 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.866575 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.867725 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:27.990038 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-156f00cf-5757-4c01-88f4-4ec5edac88f9 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Action: 'create', calling method: .version_select at 0x7f19c7ac23a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-577217133", "metadata": {"Type": "work"}}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-156f00cf-5757-4c01-88f4-4ec5edac88f9 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Request method failure captured: Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 121 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdinGNYNn2HL3MAV6DkK5_F5MjaEkcUE6DBDdCBlYINqjDOy27pR1NXToMyLLgLL5rQ0DSfUenC56DffPAI226hXsO2g0PG6v1borpmJSvFhTP3TtVHlT_lW4F38XxDI6zjnQx-Fdo4Rw-d4e96eFoLOdX9mCXQUsMr_wrSCMCIWE4 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:28.007384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_932d50c10e154de1a975be797066af93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/932d50c10e154de1a975be797066af93"}]}] Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: f8ca2eac0d21457ca347f2a48e5727f8 Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-577217133", "metadata": {"Type": "work"}}} Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:28.009008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-577217133', 'metadata': {'Type': 'work'}}}} Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise error Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:28.010350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 11:58:28.013591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 11:58:28.016705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 11:58:28.016705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.016705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-156f00cf-5757-4c01-88f4-4ec5edac88f9 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:28.016705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-156f00cf-5757-4c01-88f4-4ec5edac88f9 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.421426 Jun 03 11:58:28.027919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Jun 3 11:58:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1434 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 11:58:28.032923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f52b8ce-98ac-427c-9d84-af29b535d42d tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Action: 'create', calling method: .version_select at 0x7f19c79d1700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1623011253", "metadata": {"Type": "work"}}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f52b8ce-98ac-427c-9d84-af29b535d42d tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Request method failure captured: Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 120 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdinGNYNn2HL3MAV6DkK5_F5MjaEkcUE6DBDdCBlYINqjDOy27pR1NXToMyLLgLL5rQ0DSfUenC56DffPAI226hXsO2g0PG6v1borpmJSvFhTP3TtVHlT_lW4F38XxDI6zjnQx-Fdo4Rw-d4e96eFoLOdX9mCXQUsMr_wrSCMCIWE4 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:28.045688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_932d50c10e154de1a975be797066af93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/932d50c10e154de1a975be797066af93"}]}] Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: f8ca2eac0d21457ca347f2a48e5727f8 Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1623011253", "metadata": {"Type": "work"}}} Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:28.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1623011253', 'metadata': {'Type': 'work'}}}} Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise error Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi '0' Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:28.048137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 11:58:28.049645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 11:58:28.050893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 11:58:28.050893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.051758 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f52b8ce-98ac-427c-9d84-af29b535d42d tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:28.052749 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1f52b8ce-98ac-427c-9d84-af29b535d42d tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023708 Jun 03 11:58:28.058275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 2/2] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Jun 3 11:58:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 11:58:28.063200 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7a607ed2-2323-4e83-9c6c-d9ef315213df tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Action: 'create', calling method: .version_select at 0x7f19c7ac2700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-981090697", "metadata": {"Type": "work"}}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7a607ed2-2323-4e83-9c6c-d9ef315213df tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Request method failure captured: Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 118 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdinGNYNn2HL3MAV6DkK5_F5MjaEkcUE6DBDdCBlYINqjDOy27pR1NXToMyLLgLL5rQ0DSfUenC56DffPAI226hXsO2g0PG6v1borpmJSvFhTP3TtVHlT_lW4F38XxDI6zjnQx-Fdo4Rw-d4e96eFoLOdX9mCXQUsMr_wrSCMCIWE4 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:28.070107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_932d50c10e154de1a975be797066af93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/932d50c10e154de1a975be797066af93"}]}] Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: f8ca2eac0d21457ca347f2a48e5727f8 Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-981090697", "metadata": {"Type": "work"}}} Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:28.071664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-981090697', 'metadata': {'Type': 'work'}}}} Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise error Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi '' Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:28.073076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 11:58:28.074823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 11:58:28.076095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 11:58:28.076095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:28.077499 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7a607ed2-2323-4e83-9c6c-d9ef315213df tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:28.080114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7a607ed2-2323-4e83-9c6c-d9ef315213df tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020644 Jun 03 11:58:28.080847 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 3/3] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Jun 3 11:58:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 11:58:28.112583 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-657a2da8-05b6-4670-96db-4f22da853d80 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Calling method '.version_select at 0x7f19c7971430>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:28.441927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-34897970-51de-468f-ad06-c98f50ebce96 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Action: 'create', calling method: .version_select at 0x7f19c7ac3310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-225585805"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:29.257181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-657a2da8-05b6-4670-96db-4f22da853d80 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] HTTP exception thrown: Volume tempest-invalid-1547339362 could not be found. Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-657a2da8-05b6-4670-96db-4f22da853d80 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Request method failure captured: Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1547339362 HTTP/1.1 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdinGNYNn2HL3MAV6DkK5_F5MjaEkcUE6DBDdCBlYINqjDOy27pR1NXToMyLLgLL5rQ0DSfUenC56DffPAI226hXsO2g0PG6v1borpmJSvFhTP3TtVHlT_lW4F38XxDI6zjnQx-Fdo4Rw-d4e96eFoLOdX9mCXQUsMr_wrSCMCIWE4 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:29.262613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_932d50c10e154de1a975be797066af93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/932d50c10e154de1a975be797066af93"}]}] Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: f8ca2eac0d21457ca347f2a48e5727f8 Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Volume tempest-invalid-1547339362 could not be found. Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'tempest-invalid-1547339362'} Jun 03 11:58:29.264196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1547339362 could not be found. (HTTP 404) (Request-ID: req-2e4987de-1dad-4380-b447-71a6b4974225) Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:29.265122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 11:58:29.266619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1547339362 could not be found. Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:29.268007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1547339362 could not be found. Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1547339362 could not be found. Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-657a2da8-05b6-4670-96db-4f22da853d80 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Returning 404 to user: Volume tempest-invalid-1547339362 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-657a2da8-05b6-4670-96db-4f22da853d80 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1547339362" status: 404 len: 99 microversion: 2.1 time: 1.163602 Jun 03 11:58:29.269856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 4/4] 10.222.0.15 () {58 vars in 1217 bytes} [Fri Jun 3 11:58:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1547339362 => generated 99 bytes in 1168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 03 11:58:29.287246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-541faa13-301e-4e77-9a59-af0566ce9cbc tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017355 Jun 03 11:58:29.287809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 5/5] 10.222.0.15 () {58 vars in 1139 bytes} [Fri Jun 3 11:58:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 11:58:29.301521 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-371d3510-9094-4c36-be05-95a94172dd8c tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004305 Jun 03 11:58:29.307200 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 6/6] 10.222.0.15 () {58 vars in 1136 bytes} [Fri Jun 3 11:58:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 11:58:29.432996 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1012466904", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "networks": [{"uuid": "0875b22e-adfd-4932-ac1a-be267d2a2ce7"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:29.616873 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] validate_networks() for [('0875b22e-adfd-4932-ac1a-be267d2a2ce7', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 11:58:30.617448 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-34897970-51de-468f-ad06-c98f50ebce96 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.758569 Jun 03 11:58:30.619378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 1/7] 10.222.0.15 () {60 vars in 1154 bytes} [Fri Jun 3 11:58:26 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3762 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 03 11:58:30.626481 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-96658912-7b71-452a-8647-456df8d2e6e7 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Calling method '.version_select at 0x7f19c7988310>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:30.758880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-96658912-7b71-452a-8647-456df8d2e6e7 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] HTTP exception thrown: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-96658912-7b71-452a-8647-456df8d2e6e7 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Request method failure captured: Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/os-volumes/466686e2-d8e0-45c0-b099-34b4e1cd538e HTTP/1.1 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdinGNYNn2HL3MAV6DkK5_F5MjaEkcUE6DBDdCBlYINqjDOy27pR1NXToMyLLgLL5rQ0DSfUenC56DffPAI226hXsO2g0PG6v1borpmJSvFhTP3TtVHlT_lW4F38XxDI6zjnQx-Fdo4Rw-d4e96eFoLOdX9mCXQUsMr_wrSCMCIWE4 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 11:58:30.764033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_932d50c10e154de1a975be797066af93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/932d50c10e154de1a975be797066af93"}]}] Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: f8ca2eac0d21457ca347f2a48e5727f8 Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '466686e2-d8e0-45c0-b099-34b4e1cd538e'} Jun 03 11:58:30.765479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. (HTTP 404) (Request-ID: req-111ac679-c19a-479b-80c3-4fe28a67346e) Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:30.766253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 11:58:30.767360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 11:58:30.768535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. Jun 03 11:58:30.769694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:30.773815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-96658912-7b71-452a-8647-456df8d2e6e7 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Returning 404 to user: Volume 466686e2-d8e0-45c0-b099-34b4e1cd538e could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:30.776126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-96658912-7b71-452a-8647-456df8d2e6e7 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/466686e2-d8e0-45c0-b099-34b4e1cd538e" status: 404 len: 109 microversion: 2.1 time: 0.155042 Jun 03 11:58:30.783432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 2/8] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 11:58:30 2022] DELETE /compute/v2.1/os-volumes/466686e2-d8e0-45c0-b099-34b4e1cd538e => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:30.796904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ae630952-7174-4b4f-b86d-599cde15d472 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c78e8af0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:30.961814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ae630952-7174-4b4f-b86d-599cde15d472 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 200 len: 344 microversion: 2.1 time: 0.177203 Jun 03 11:58:30.962962 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 3/9] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 11:58:30 2022] GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:30.968196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b5469bbc-2a8f-42a5-914d-576321e04349 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Calling method '.version_select at 0x7f19c78e8550>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:31.021450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-b5469bbc-2a8f-42a5-914d-576321e04349 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] HTTP exception thrown: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b5469bbc-2a8f-42a5-914d-576321e04349 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Request method failure captured: Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/os-volumes/18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 HTTP/1.1 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdinGNYNn2HL3MAV6DkK5_F5MjaEkcUE6DBDdCBlYINqjDOy27pR1NXToMyLLgLL5rQ0DSfUenC56DffPAI226hXsO2g0PG6v1borpmJSvFhTP3TtVHlT_lW4F38XxDI6zjnQx-Fdo4Rw-d4e96eFoLOdX9mCXQUsMr_wrSCMCIWE4 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 11:58:31.028409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_932d50c10e154de1a975be797066af93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/932d50c10e154de1a975be797066af93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/932d50c10e154de1a975be797066af93"}]}] Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 932d50c10e154de1a975be797066af93 Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-VolumesNegativeTest-1671538908 Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: f8ca2eac0d21457ca347f2a48e5727f8 Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-VolumesNegativeTest-1671538908-project Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '18ffce5d-ffe3-49c9-ac20-c242ea98a2b0'} Jun 03 11:58:31.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. (HTTP 404) (Request-ID: req-87f281f5-f1e2-4179-8819-728342de5812) Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:31.031073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:31.033124 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 11:58:31.034270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b5469bbc-2a8f-42a5-914d-576321e04349 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] Returning 404 to user: Volume 18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b5469bbc-2a8f-42a5-914d-576321e04349 tempest-VolumesNegativeTest-1671538908 tempest-VolumesNegativeTest-1671538908-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/18ffce5d-ffe3-49c9-ac20-c242ea98a2b0" status: 404 len: 109 microversion: 2.1 time: 0.065844 Jun 03 11:58:31.035744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 4/10] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 11:58:30 2022] GET /compute/v2.1/os-volumes/18ffce5d-ffe3-49c9-ac20-c242ea98a2b0 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:31.124939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 11:58:31.125997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 11:58:31.126673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 11:58:31.127246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 11:58:31.127881 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 11:58:31.147804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:31.148754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:31.149658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:31.150092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:31.249178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Getting quotas for project d10936ccaf444728a01afc3f374e2285. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 11:58:31.270571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Getting quotas for user 8e1d264439b340c3af56cad54b7bc4a4 and project d10936ccaf444728a01afc3f374e2285. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 11:58:31.376347 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 11:58:31.382058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 11:58:31.562611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fdc1aa1d-e86c-44b1-9451-66bf08005d2c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245531 Jun 03 11:58:31.570513 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 7/11] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 11:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 11:58:31.573820 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c0f7a1d3-c79f-4e09-90ec-e6edee0c832c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:31.574566 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c0f7a1d3-c79f-4e09-90ec-e6edee0c832c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:31.937178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c0f7a1d3-c79f-4e09-90ec-e6edee0c832c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:31.988153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a617c865-affc-4260-8eb2-725c0eeb0b10 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c6f9d940>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:31.998629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c0f7a1d3-c79f-4e09-90ec-e6edee0c832c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1215 microversion: 2.1 time: 0.428594 Jun 03 11:58:32.005415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 5/12] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:31 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1215 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:32.097944 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a617c865-affc-4260-8eb2-725c0eeb0b10 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 200 len: 345 microversion: 2.1 time: 0.126729 Jun 03 11:58:32.099125 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 11:58:31 2022] GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:32.112017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d7e74981-dc05-4876-ac30-33891430ffcd tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Action: 'create', calling method: .version_select at 0x7f19c78bcf70>, body: {"snapshot": {"volume_id": "f539e97d-cd24-4306-9e02-7dd841baf248", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1207202910"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:32.677235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d7e74981-dc05-4876-ac30-33891430ffcd tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.569582 Jun 03 11:58:32.677819 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 6/14] 10.222.0.15 () {60 vars in 1161 bytes} [Fri Jun 3 11:58:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:32.692568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c4a5e35a-0dca-4c84-9702-97db9a3b8e54 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c6f9db80>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:32.796245 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c4a5e35a-0dca-4c84-9702-97db9a3b8e54 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.111586 Jun 03 11:58:32.797350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 9/15] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:32 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:32.812133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c68a378f-dfd0-4fc5-873d-3054d52d5dd4 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c78c75e0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:33.034001 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0ea556de-75e9-4177-806d-d87242031249 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:33.034627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0ea556de-75e9-4177-806d-d87242031249 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:33.111411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c68a378f-dfd0-4fc5-873d-3054d52d5dd4 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.308151 Jun 03 11:58:33.117182 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 7/16] 10.222.0.15 () {58 vars in 1139 bytes} [Fri Jun 3 11:58:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:33.123198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-33976f5f-f821-4b55-8fa6-57efdb20b783 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c78bce50>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:33.199557 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-33976f5f-f821-4b55-8fa6-57efdb20b783 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.080978 Jun 03 11:58:33.200659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:33 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 11:58:33.307211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0ea556de-75e9-4177-806d-d87242031249 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:33.342105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0ea556de-75e9-4177-806d-d87242031249 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1215 microversion: 2.1 time: 0.313201 Jun 03 11:58:33.346512 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:33 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:34.213164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0b50b527-b071-45b9-8cbb-84bf9d14a064 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c78c7e50>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:34.351369 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0b50b527-b071-45b9-8cbb-84bf9d14a064 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.142430 Jun 03 11:58:34.352092 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:34 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:34.364166 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:34.365570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:34.377192 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:34.377990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:34.379030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:34.379926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:35.017160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:35.039442 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-04e9f44c-ecec-4524-9a17-851324ccadec tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1219 microversion: 2.1 time: 0.680954 Jun 03 11:58:35.052068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 11/20] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:34 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1219 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:35.364206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-14ad25a2-c588-48e8-970c-52870d130357 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c78c7790>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:35.429622 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-14ad25a2-c588-48e8-970c-52870d130357 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.070016 Jun 03 11:58:35.430197 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 10/21] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:35 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:36.059966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:36.061995 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:36.076210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:36.078008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:36.085010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:36.086701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:36.266059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:36.289502 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9001391a-056e-490a-a15d-2b6c2b340d70 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1219 microversion: 2.1 time: 0.235142 Jun 03 11:58:36.302118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:36 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1219 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:36.441498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-53e58752-6b4e-4ef6-9a0e-3e9b6573fe9f tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c66da700>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:36.529728 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-53e58752-6b4e-4ef6-9a0e-3e9b6573fe9f tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.092174 Jun 03 11:58:36.530632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:36 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:36.650239 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f883c6db-4208-4068-9d98-e399ce73c64e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'create', calling method: .version_select at 0x7f19c78bce50>, body: {"keypair": {"name": "tempest-keypair-104863110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOUpedCWPtp/E1yLZgZ3Hp8CvbOLJiMROm7WbebIs9pn14gRKfrRkqm3onUBdfZ0xMI9U4SB+ej9x7PyAoyPhpV+tjte29ojhn9T0pYrvDNX1ThtPVATCHJnh3KKIDIVQ=="}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:36.709717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f883c6db-4208-4068-9d98-e399ce73c64e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for project 89467b1c15334264bf384b711292808b. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 11:58:36.719740 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f883c6db-4208-4068-9d98-e399ce73c64e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for user b76f9ea7268a4e70a402f3c9ea6220e7 and project 89467b1c15334264bf384b711292808b. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 11:58:36.807622 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f883c6db-4208-4068-9d98-e399ce73c64e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.438442 Jun 03 11:58:36.816894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 11/24] 10.222.0.15 () {62 vars in 1199 bytes} [Fri Jun 3 11:58:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 450 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 11:58:37.308388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:37.309687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:37.318817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:37.322493 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:37.323563 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:37.328355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:37.543258 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a40c8192-518c-4cf5-9a58-f6c0d78b9c54 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c781dee0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:37.598660 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a40c8192-518c-4cf5-9a58-f6c0d78b9c54 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.060406 Jun 03 11:58:37.599580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:37 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:37.766456 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:37.776410 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9807fd92-adc4-4327-a2ad-db5e38c95f25 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1219 microversion: 2.1 time: 0.472421 Jun 03 11:58:37.791956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 14/26] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:37 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1219 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:38.613535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5db67edd-a466-43c8-9d4e-2017ac5cec08 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c784f550>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:38.671617 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5db67edd-a466-43c8-9d4e-2017ac5cec08 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.064366 Jun 03 11:58:38.673482 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:38 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:38.801640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:38.804266 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:38.820765 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:38.823053 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:38.825410 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:38.825893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:38.991168 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:39.000631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-334829a3-883f-4e5a-a3ba-7f4e737d4d56 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1219 microversion: 2.1 time: 0.206120 Jun 03 11:58:39.003387 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:38 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:39.653140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1710822101", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:39.692236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e8e08b86-de64-4c64-b629-6c7d2f0d4f0c tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c6717280>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:39.745534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e8e08b86-de64-4c64-b629-6c7d2f0d4f0c tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 288 microversion: 2.1 time: 0.064183 Jun 03 11:58:39.747733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:39 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:39.758354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ed794e3a-1079-44a3-a894-1a1360b28ac1 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c66dc430>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:39.913413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] validate_networks() for [('f261ea3b-fc07-4f2c-9a10-192bbbd56274', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 11:58:39.978207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ed794e3a-1079-44a3-a894-1a1360b28ac1 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 202 len: 0 microversion: 2.1 time: 0.224328 Jun 03 11:58:39.979769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 17/30] 10.222.0.15 () {58 vars in 1253 bytes} [Fri Jun 3 11:58:39 2022] DELETE /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 11:58:39.997202 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-631cdf16-2ad6-482c-8b3a-44c0c0c2df41 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c66dc1f0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:40.089927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-631cdf16-2ad6-482c-8b3a-44c0c0c2df41 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 200 len: 287 microversion: 2.1 time: 0.105876 Jun 03 11:58:40.090586 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 18/31] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:39 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:40.100537 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:40.101402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:40.126062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:40.131885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:40.133064 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:40.134270 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:40.688527 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:40.712546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fd7c4606-8287-470e-9b68-e16ccae4485a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1285 microversion: 2.1 time: 0.612465 Jun 03 11:58:40.713894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 19/32] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:40 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1285 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:40.728652 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1590640342", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b38da822-736c-4493-ac79-a664e16e017e"}], "security_groups": [{"name": "tempest-securitygroup--598867438"}], "key_name": "tempest-keypair-104863110", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:41.055523 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] validate_networks() for [('b38da822-736c-4493-ac79-a664e16e017e', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 11:58:41.168969 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:41.796526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 11:58:41.797576 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 11:58:41.798438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 11:58:41.799277 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 11:58:41.800059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 11:58:41.842356 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:41.842816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:41.846481 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:41.847190 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:41.947592 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for project 799fb68a55084528ab5573051a1bf121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 11:58:41.957923 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for user abcc58cb66804297b184e41726c281bb and project 799fb68a55084528ab5573051a1bf121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 11:58:41.987822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 11:58:41.992635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 11:58:42.108824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2fe22261-59c2-4fe0-9f4e-349c653ebccb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.903174 Jun 03 11:58:42.114727 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 14/33] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 11:58:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 11:58:42.115191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8e720cce-2020-4054-afca-d0dd2027138b tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c6fcdd30>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:42.167226 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-8e720cce-2020-4054-afca-d0dd2027138b tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] HTTP exception thrown: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8e720cce-2020-4054-afca-d0dd2027138b tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Request method failure captured: Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 HTTP/1.1 Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdib-GoZe5HxyWxa5VTKG3e_cBd6Q2PDhjKoR7We7lXOMkUTk5n-NIvoTC5nZO3D255eA-Gk-9dSe4T7JhKzBuB58RSAw9DlkORMWfrplJQhfycrB-QpcatXzKBl2S1pb_mMsbLJa0ucBwarMBnhTj2dPNqBS6IT-upgjWWYVsdYtI Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 11:58:42.169842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}] Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: d25b6b5454bb4aa2b3c24ca97cef9c72 Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '426b0020-73ba-4c34-a83d-6d62be622d29'} Jun 03 11:58:42.171186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. (HTTP 404) (Request-ID: req-49066811-940f-48e5-a550-36d79431394a) Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.172047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:42.173109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 11:58:42.174164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. Jun 03 11:58:42.175335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 11:58:42.176235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8e720cce-2020-4054-afca-d0dd2027138b tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Returning 404 to user: Snapshot 426b0020-73ba-4c34-a83d-6d62be622d29 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:42.177225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8e720cce-2020-4054-afca-d0dd2027138b tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29" status: 404 len: 111 microversion: 2.1 time: 0.066157 Jun 03 11:58:42.182237 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 15/34] 10.222.0.15 () {58 vars in 1250 bytes} [Fri Jun 3 11:58:42 2022] GET /compute/v2.1/os-snapshots/426b0020-73ba-4c34-a83d-6d62be622d29 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:42.188954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:42.190029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:42.202130 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:42.202960 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:42.204157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:42.204810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:42.761482 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:42.802750 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-aebd0149-97ec-4d95-973e-50e15053084d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1273 microversion: 2.1 time: 0.597745 Jun 03 11:58:42.804902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 16/35] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:42 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1273 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:42.833171 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cce6231c-1fa4-43ac-9d28-2877ac89715e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:42.834061 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cce6231c-1fa4-43ac-9d28-2877ac89715e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:43.075230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cce6231c-1fa4-43ac-9d28-2877ac89715e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:43.099026 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cce6231c-1fa4-43ac-9d28-2877ac89715e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1222 microversion: 2.1 time: 0.278469 Jun 03 11:58:43.121076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 17/36] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:42 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:43.147034 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2d50c974-9ba5-4c69-bac2-9ee9b4a98143 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c5ee1a60>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:43.334797 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=8 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:43.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2d50c974-9ba5-4c69-bac2-9ee9b4a98143 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 202 len: 0 microversion: 2.1 time: 0.219801 Jun 03 11:58:43.344533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 18/37] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 11:58:43 2022] DELETE /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 11:58:43.356318 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5adbced4-297e-4e1d-be00-9df434672a20 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c5ea90d0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:43.489231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5adbced4-297e-4e1d-be00-9df434672a20 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 200 len: 344 microversion: 2.1 time: 0.140130 Jun 03 11:58:43.494874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 11:58:43 2022] GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 11:58:43.505165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-159159753", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:43.632487 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] validate_networks() for [('f261ea3b-fc07-4f2c-9a10-192bbbd56274', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 11:58:44.157390 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 11:58:44.157723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 11:58:44.158204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 11:58:44.158618 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 11:58:44.159048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 11:58:44.193912 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:44.194411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:44.195203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:44.203216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:44.275452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for project 89467b1c15334264bf384b711292808b. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 11:58:44.282469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for user b76f9ea7268a4e70a402f3c9ea6220e7 and project 89467b1c15334264bf384b711292808b. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 11:58:44.297715 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 11:58:44.300789 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 11:58:44.437802 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-33433c86-5732-4377-9a95-a1ede5c5d179 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.722629 Jun 03 11:58:44.438541 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 20/39] 10.222.0.15 () {62 vars in 1187 bytes} [Fri Jun 3 11:58:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 3724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 11:58:44.456281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:44.456895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:44.503184 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:44.507070 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:44.509348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:44.511857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:45.022419 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:45.054429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7b91cc34-30de-409a-b5fb-a98110397e04 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.602046 Jun 03 11:58:45.067536 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 21/40] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:44 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:45.104092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e42688ff-528a-46e1-b291-9743a728a546 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:45.104712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e42688ff-528a-46e1-b291-9743a728a546 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:45.288443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e42688ff-528a-46e1-b291-9743a728a546 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:45.299356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e42688ff-528a-46e1-b291-9743a728a546 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:45.309419 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e42688ff-528a-46e1-b291-9743a728a546 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:45.310842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e42688ff-528a-46e1-b291-9743a728a546 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1281 microversion: 2.20 time: 0.240830 Jun 03 11:58:45.312816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 22/41] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:45 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:58:45.352026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c0a20ed-f55c-45bf-865a-9ff5619d89e5 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c66d8670>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:45.477883 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5c0a20ed-f55c-45bf-865a-9ff5619d89e5 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] HTTP exception thrown: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c0a20ed-f55c-45bf-865a-9ff5619d89e5 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Request method failure captured: Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 HTTP/1.1 Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdib-GoZe5HxyWxa5VTKG3e_cBd6Q2PDhjKoR7We7lXOMkUTk5n-NIvoTC5nZO3D255eA-Gk-9dSe4T7JhKzBuB58RSAw9DlkORMWfrplJQhfycrB-QpcatXzKBl2S1pb_mMsbLJa0ucBwarMBnhTj2dPNqBS6IT-upgjWWYVsdYtI Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:45.480887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}] Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: d25b6b5454bb4aa2b3c24ca97cef9c72 Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'f539e97d-cd24-4306-9e02-7dd841baf248'} Jun 03 11:58:45.482144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. (HTTP 404) (Request-ID: req-53d5a570-91e6-4bf3-8102-825fd77e5cc1) Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.482897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:45.484187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 11:58:45.485275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.486631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.488649 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c0a20ed-f55c-45bf-865a-9ff5619d89e5 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Returning 404 to user: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:45.490002 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5c0a20ed-f55c-45bf-865a-9ff5619d89e5 tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 404 len: 109 microversion: 2.1 time: 0.175794 Jun 03 11:58:45.491237 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 23/42] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 11:58:45 2022] GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:45.513474 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72f2a4db-1637-48ff-81bf-7306ebd4a4db tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c66d8f70>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:45.565802 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 11:58:45.566307 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 11:58:45.566763 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 11:58:45.567420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 11:58:45.567871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 11:58:45.587169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:45.588811 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:45.595630 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:45.596087 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:45.634044 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-72f2a4db-1637-48ff-81bf-7306ebd4a4db tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] HTTP exception thrown: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72f2a4db-1637-48ff-81bf-7306ebd4a4db tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Request method failure captured: Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 HTTP/1.1 Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdib-GoZe5HxyWxa5VTKG3e_cBd6Q2PDhjKoR7We7lXOMkUTk5n-NIvoTC5nZO3D255eA-Gk-9dSe4T7JhKzBuB58RSAw9DlkORMWfrplJQhfycrB-QpcatXzKBl2S1pb_mMsbLJa0ucBwarMBnhTj2dPNqBS6IT-upgjWWYVsdYtI Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:45.636235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}] Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: d25b6b5454bb4aa2b3c24ca97cef9c72 Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'f539e97d-cd24-4306-9e02-7dd841baf248'} Jun 03 11:58:45.637486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. (HTTP 404) (Request-ID: req-3ac1230a-997f-468c-995c-116e5ec7f1de) Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.638141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 11:58:45.639123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 11:58:45.640069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72f2a4db-1637-48ff-81bf-7306ebd4a4db tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Returning 404 to user: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72f2a4db-1637-48ff-81bf-7306ebd4a4db tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 404 len: 109 microversion: 2.1 time: 0.136374 Jun 03 11:58:45.644372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 24/43] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 11:58:45 2022] DELETE /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:45.647876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-981f7eb8-7a18-4e7b-9309-e0385d61d6df tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Calling method '.version_select at 0x7f19c6717ee0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:45.675737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for project 799fb68a55084528ab5573051a1bf121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 11:58:45.710187 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for user abcc58cb66804297b184e41726c281bb and project 799fb68a55084528ab5573051a1bf121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 11:58:45.733921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-981f7eb8-7a18-4e7b-9309-e0385d61d6df tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] HTTP exception thrown: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-981f7eb8-7a18-4e7b-9309-e0385d61d6df tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Request method failure captured: Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 HTTP/1.1 Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdib-GoZe5HxyWxa5VTKG3e_cBd6Q2PDhjKoR7We7lXOMkUTk5n-NIvoTC5nZO3D255eA-Gk-9dSe4T7JhKzBuB58RSAw9DlkORMWfrplJQhfycrB-QpcatXzKBl2S1pb_mMsbLJa0ucBwarMBnhTj2dPNqBS6IT-upgjWWYVsdYtI Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 11:58:45.736602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c931d0d666d47c8a1c7bd1b3d83aec0"}]}] Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 2c931d0d666d47c8a1c7bd1b3d83aec0 Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478551255 Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: d25b6b5454bb4aa2b3c24ca97cef9c72 Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478551255-project Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'f539e97d-cd24-4306-9e02-7dd841baf248'} Jun 03 11:58:45.738151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. (HTTP 404) (Request-ID: req-29291249-a838-4c7c-b7c8-a50f1393f6dd) Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.738957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 11:58:45.740003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 11:58:45.741305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. Jun 03 11:58:45.743351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 11:58:45.749991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-981f7eb8-7a18-4e7b-9309-e0385d61d6df tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] Returning 404 to user: Volume f539e97d-cd24-4306-9e02-7dd841baf248 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 11:58:45.749991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-981f7eb8-7a18-4e7b-9309-e0385d61d6df tempest-VolumesSnapshotsTestJSON-478551255 tempest-VolumesSnapshotsTestJSON-478551255-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248" status: 404 len: 109 microversion: 2.1 time: 0.102105 Jun 03 11:58:45.750526 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 25/44] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 11:58:45 2022] GET /compute/v2.1/os-volumes/f539e97d-cd24-4306-9e02-7dd841baf248 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:45.757477 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 11:58:45.771112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 11:58:45.984224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f907e014-47d6-45fc-a033-2c5e1b34bb45 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.486843 Jun 03 11:58:45.991690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 20/45] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 11:58:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 11:58:46.003672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f012f9cd-e5e9-4987-934e-e03d6d148b1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:46.004398 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f012f9cd-e5e9-4987-934e-e03d6d148b1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:46.075635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:46.076793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:46.094550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:46.095250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:46.096919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:46.097533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:46.195745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f012f9cd-e5e9-4987-934e-e03d6d148b1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:46.207477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f012f9cd-e5e9-4987-934e-e03d6d148b1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1221 microversion: 2.1 time: 0.207920 Jun 03 11:58:46.208388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 26/46] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:45 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1221 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:46.331716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:46.332573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:46.343348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:46.347337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:46.349633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:46.352003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:46.846199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:46.864991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:46.866973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:46.875922 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-90a6afa3-fad6-4b87-926d-17468735367b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1277 microversion: 2.20 time: 0.548646 Jun 03 11:58:46.880231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 27/47] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:46 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1277 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:58:47.228513 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:47.229750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:47.243463 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:47.246092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:47.247177 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:47.249316 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:47.387594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:47.397895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ac320720-56bd-4e07-a8e0-5bda2aec7746 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 1.326913 Jun 03 11:58:47.399875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 21/48] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:46 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:58:47.877050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:47.899480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:47.900472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:47.904214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-46731e71-5a81-48e3-b644-027c8c05d2ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1225 microversion: 2.1 time: 0.665666 Jun 03 11:58:47.904307 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 28/49] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:47 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1225 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:47.914825 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:47.917999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:47.919179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:47.920123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:48.257399 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:48.274889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:48.282766 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:48.284422 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-28658cdd-a8bb-4bbb-86d5-c364443d2e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1351 microversion: 2.20 time: 0.389968 Jun 03 11:58:48.285459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 22/50] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:47 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1351 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:58:48.416017 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:48.417190 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:48.441384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:48.448921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:48.453283 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:48.457997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:48.922036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:48.922769 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:48.941118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:48.946945 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:48.954808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:48.958813 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:49.424867 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:49.435738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5ccb9976-4044-4f15-9b48-4069b0a37d51 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1217 microversion: 2.1 time: 0.517995 Jun 03 11:58:49.453495 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 23/51] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:48 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1217 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:58:49.457392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:49.458083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:49.488885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:49.498324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:49.499352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:49.499961 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:49.693245 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:49.705158 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:49.712095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:49.712709 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:49.714196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4efc1bc1-a4fc-44e5-aaea-961e1b77edba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1339 microversion: 2.20 time: 0.268996 Jun 03 11:58:49.714771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 24/52] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:49 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:58:49.731471 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-70c18b15-87df-4bdb-b870-ab552ff72700 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 1.319966 Jun 03 11:58:49.733392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 29/53] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:48 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:50.468764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:50.470096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:50.482016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:50.483024 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:50.485663 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:50.486178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:50.728818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:50.734029 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:50.736376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:50.738085 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-219bedfa-63d9-42f9-a414-ed4d06f4c294 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1279 microversion: 2.1 time: 0.274261 Jun 03 11:58:50.748554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 25/54] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:50 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:50.768996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:50.769964 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:50.771988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:50.782958 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:50.784608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:50.785767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:50.796145 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:50.796633 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:50.797460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:50.797904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:51.240243 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:51.260656 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c9f7d6d6-5c0f-4f03-ba2f-fa21221c664f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.507395 Jun 03 11:58:51.274882 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 26/55] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:50 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:51.324516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:51.343182 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:51.346420 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:51.348553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-53424f62-d17d-414a-8243-b2e7e2928a55 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1339 microversion: 2.20 time: 0.618650 Jun 03 11:58:51.350740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 30/56] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:50 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1339 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:58:51.766380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:51.767159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:51.804229 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:51.806275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:51.808783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:51.812462 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.087138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:52.104841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-59a62b12-ac02-4adc-9f7f-763d84b31365 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1279 microversion: 2.1 time: 0.343454 Jun 03 11:58:52.106549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 31/57] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:51 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1279 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:52.115553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-2443c79e-336d-4913-a591-b41e1bdb89b9 req-9d56c64d-4157-4c2d-96b1-923cd450359f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ea1333-a55a-4e41-bef1-80263aa05089", "tag": "b1031a51-e343-44fb-8ae5-30c4f910486f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:52.148460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-2443c79e-336d-4913-a591-b41e1bdb89b9 req-9d56c64d-4157-4c2d-96b1-923cd450359f service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.151778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-2443c79e-336d-4913-a591-b41e1bdb89b9 req-9d56c64d-4157-4c2d-96b1-923cd450359f service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.219702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-2443c79e-336d-4913-a591-b41e1bdb89b9 req-9d56c64d-4157-4c2d-96b1-923cd450359f service nova] Creating event network-changed:b1031a51-e343-44fb-8ae5-30c4f910486f for instance 40ea1333-a55a-4e41-bef1-80263aa05089 on hv-cinder-84457 Jun 03 11:58:52.220314 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-2443c79e-336d-4913-a591-b41e1bdb89b9 req-9d56c64d-4157-4c2d-96b1-923cd450359f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 11:58:52.221770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.224066 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.227895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.231036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.267781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.compute.rpcapi [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 11:58:52.284391 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] Releasing lock "compute-rpcapi-router" {{(pid=117617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 11:58:52.286268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:52.287004 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:52.299975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.300555 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.317467 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.318534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.321436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0d77a57c-420d-4b6f-8256-0efde9f9bf38 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.778103 Jun 03 11:58:52.324981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 27/58] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:52.372660 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:52.374018 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:52.387902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.388874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.391269 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:52.391935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:52.776911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:52.794545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fac5ae47-5313-413e-a617-93888912535c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.512743 Jun 03 11:58:52.795991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 32/59] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:52 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:53.122657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:53.123718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:53.145105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:53.145725 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:53.148964 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:53.150339 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:53.332916 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:53.343691 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:53.345888 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:53.347702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a228cba4-19b6-414e-a1b4-fb4c22ea7d89 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.981262 Jun 03 11:58:53.349117 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 28/60] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:52 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:58:53.483227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:53.524975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7c454bda-819e-4d2e-ad7f-9e63742804e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1279 microversion: 2.1 time: 0.405760 Jun 03 11:58:53.527123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 33/61] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:53 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1279 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:58:53.813541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:53.814941 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:53.829658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:53.830323 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:53.832977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:53.835297 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:54.366582 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:54.367403 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:54.372938 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:54.381434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:54.387603 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:54.389036 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:54.390274 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:55.008906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:55.035376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1ca61543-6b27-4c89-9b00-a9fc869035ad tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 1.226998 Jun 03 11:58:55.036011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 29/62] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:53 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:55.097393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:55.112055 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:55.118600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:55.121087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-84246b4d-4480-40ad-84b3-ab9426ca3e02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.758465 Jun 03 11:58:55.122132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 34/63] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:54 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:58:55.134521 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:55.140378 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:55.157431 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:55.158158 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:55.159199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:55.162506 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:55.341243 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:55.353898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-27692104-ec94-414a-8d12-6e5f56ae778a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1279 microversion: 2.1 time: 0.227110 Jun 03 11:58:55.364239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 35/64] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:55 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:55.457566 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-fea94d51-0ac0-4f14-b8b2-c176a281bc6c req-1b8c61af-ea29-4c8f-9690-8bcb4c4ea615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7dbfbf-015e-447d-96cd-5ab9efa88d62", "tag": "def82060-451f-48f0-9d78-a33f82670dc7"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:55.474445 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-fea94d51-0ac0-4f14-b8b2-c176a281bc6c req-1b8c61af-ea29-4c8f-9690-8bcb4c4ea615 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:55.474900 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-fea94d51-0ac0-4f14-b8b2-c176a281bc6c req-1b8c61af-ea29-4c8f-9690-8bcb4c4ea615 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:55.492108 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-fea94d51-0ac0-4f14-b8b2-c176a281bc6c req-1b8c61af-ea29-4c8f-9690-8bcb4c4ea615 service nova] Creating event network-changed:def82060-451f-48f0-9d78-a33f82670dc7 for instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 on hv-cinder-84457 Jun 03 11:58:55.501553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-fea94d51-0ac0-4f14-b8b2-c176a281bc6c req-1b8c61af-ea29-4c8f-9690-8bcb4c4ea615 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.460490 Jun 03 11:58:55.502418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 30/65] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:56.052904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:56.054738 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:56.068331 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.068967 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.069768 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.072767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.139371 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=20 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:56.145227 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:56.145939 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:56.177589 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.178038 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.178838 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.179244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.223351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=10 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:56.520838 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:56.530373 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:56.534192 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:56.539241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-53a27acd-d88d-4084-981c-156d2399eb4c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.400727 Jun 03 11:58:56.541608 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 31/66] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:56 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:58:56.559603 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:56.563185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:56.568585 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d1030452-ceaf-4a06-ab79-0dbd2277d730 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.519424 Jun 03 11:58:56.569160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 36/67] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:56 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:56.572609 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-7f32d078-a077-4a7c-8893-f0f298d1931e req-08f28973-97e8-4696-a2ca-128edc2a6c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:56.580732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-7f32d078-a077-4a7c-8893-f0f298d1931e req-08f28973-97e8-4696-a2ca-128edc2a6c03 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.581173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-7f32d078-a077-4a7c-8893-f0f298d1931e req-08f28973-97e8-4696-a2ca-128edc2a6c03 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.581392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:56.582979 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:56.591118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.591587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.592409 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:56.593083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:56.594668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-7f32d078-a077-4a7c-8893-f0f298d1931e req-08f28973-97e8-4696-a2ca-128edc2a6c03 service nova] Creating event network-changed:afce902f-86ce-4fca-bc6c-a632e1f83134 for instance a5e00459-a0d4-4520-bc60-02901fe74ffe on hv-cinder-84457 Jun 03 11:58:56.601386 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-7f32d078-a077-4a7c-8893-f0f298d1931e req-08f28973-97e8-4696-a2ca-128edc2a6c03 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056896 Jun 03 11:58:56.602524 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 32/68] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:56.751616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:56.761129 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bd48f4b2-5b18-42aa-8d15-0a1ec9a19820 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.190918 Jun 03 11:58:56.761903 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 37/69] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:56 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:57.561035 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:57.561738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:57.563810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:57.572974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:57.573426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:57.574202 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:57.574638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:57.585667 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:57.586662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:57.589499 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:57.595811 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:57.596485 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:57.597469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:57.598278 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:57.762328 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:57.775537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:57.778273 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:57.779444 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5c092f1f-e302-4d48-b512-15d8e4cf1ae6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.222626 Jun 03 11:58:57.790760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 33/70] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:57 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:58:57.797091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:57.798011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:57.806664 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:57.807261 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:57.808262 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:57.808824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:58.086421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:58.100654 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0529ae80-027a-4d9c-944f-0117ac2a1a85 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.307734 Jun 03 11:58:58.115736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:58.122436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 34/71] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:57 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:58:58.125757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fc5d0f48-d935-46b2-ac9a-df0c2ef0f431 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.543942 Jun 03 11:58:58.126970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 38/72] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:57 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:58:58.800286 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:58.801168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:58.813354 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:58.816692 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:58.818268 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:58.818714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:58.836933 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-b0c5798f-5033-4197-b7a4-d5212ee53013 req-62789908-cf1e-4ba1-ba65-455f8dc3e064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "773c52dc-848f-4fe8-bb42-02d7bce02898", "tag": "d2f7adff-2e38-430b-9551-404dd7ca8229"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:58:58.882144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-b0c5798f-5033-4197-b7a4-d5212ee53013 req-62789908-cf1e-4ba1-ba65-455f8dc3e064 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:58.885140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-b0c5798f-5033-4197-b7a4-d5212ee53013 req-62789908-cf1e-4ba1-ba65-455f8dc3e064 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:58.942606 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-b0c5798f-5033-4197-b7a4-d5212ee53013 req-62789908-cf1e-4ba1-ba65-455f8dc3e064 service nova] Creating event network-changed:d2f7adff-2e38-430b-9551-404dd7ca8229 for instance 773c52dc-848f-4fe8-bb42-02d7bce02898 on hv-cinder-84457 Jun 03 11:58:58.943160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-b0c5798f-5033-4197-b7a4-d5212ee53013 req-62789908-cf1e-4ba1-ba65-455f8dc3e064 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 11:58:58.944328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:58.944763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:58.946904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:58.947338 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:58.968564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.compute.rpcapi [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 11:58:58.969457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] Releasing lock "compute-rpcapi-router" {{(pid=117618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 11:58:59.008024 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6d676838-7538-4022-9a5b-8cf5582f3a16 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174978 Jun 03 11:58:59.008930 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 39/73] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:58:59.088263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:59.097868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:59.099615 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:59.101017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b04b0fc6-1454-4696-9750-d25414f15027 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.306404 Jun 03 11:58:59.113307 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 35/74] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:58:58 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:58:59.119310 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:59.121626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:59.135180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:59.135779 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:59.136953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:59.138074 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:59.142755 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:58:59.144297 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:58:59.151926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:59.154690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:59.157955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:58:59.158472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:58:59.362095 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:59.370420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ef899559-1ce3-423b-bf0b-1a8d1ccad6bd tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.231881 Jun 03 11:58:59.371420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 36/75] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:59 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:58:59.371585 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:58:59.383863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a802f6ba-eaa4-4811-8688-dbcb34f32f7f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.269227 Jun 03 11:58:59.385249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 40/76] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:58:59 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:00.120379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:00.121023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:00.130263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:00.130803 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:00.131683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:00.132187 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:00.154035 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=100 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:00.298749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:00.306780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:00.308470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:00.309616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a9f27bc7-3bcc-41e4-a59d-52b645146b9b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.193867 Jun 03 11:59:00.310368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 37/77] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:00 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:00.389572 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:00.390167 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:00.400461 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:00.401178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:00.402489 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:00.402885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:00.406584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:00.407463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:00.423157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:00.423884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:00.427063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:00.428626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:00.581327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:00.599618 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-54400768-a96c-4f26-8c7d-5cb52cfd664b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.216249 Jun 03 11:59:00.600999 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:00 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:00.643428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:00.663895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cee126da-b230-4f45-ab2f-122d33f9ef5a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.266700 Jun 03 11:59:00.665415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 38/79] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:00 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:01.328480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:01.329921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:01.342101 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:01.342101 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:01.342875 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:01.342969 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:01.533351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:01.542403 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:01.544791 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:01.545904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d43c83c4-82ab-4718-b7c1-c7ec3f43dea2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.222041 Jun 03 11:59:01.547094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 42/80] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:01 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:01.618269 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:01.619514 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:01.632065 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:01.632764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:01.633797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:01.634405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:01.687334 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:01.688066 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:01.695236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:01.695716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:01.697003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:01.697646 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:01.865033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:01.872489 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5245c0c0-213c-461b-847b-79aab6cd6a30 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.258593 Jun 03 11:59:01.873051 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 39/81] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:01 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:01.881545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:01.889310 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-00e9e27c-9a67-4b69-ba8e-e46b066f43c2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.207864 Jun 03 11:59:01.912722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 43/82] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:01 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:02.565337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:02.565947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:02.568920 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:02.574258 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:02.574753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:02.575673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:02.576140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:02.762614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:02.772708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:02.774644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:02.776259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1d0800a1-e986-44b1-bd03-8991d7ecae02 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.215581 Jun 03 11:59:02.777393 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 40/83] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:02 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:02.889532 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:02.890806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:02.897608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:02.898289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:02.899062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:02.899519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:02.910198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:02.910901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:02.919285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:02.919975 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:02.920943 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:02.921568 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:03.048018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:03.056348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f4fcda81-2849-4998-9094-b72ec07314b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.170511 Jun 03 11:59:03.067077 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 44/84] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:02 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:03.090292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:03.097952 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e4937c81-1cc3-4fe1-9fa2-bab1a2752d68 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.195195 Jun 03 11:59:03.098675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 41/85] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:02 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:03.794350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:03.794948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:03.801172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:03.801618 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:03.802372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:03.802800 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:03.939266 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:03.947789 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:03.949274 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:03.950362 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-12f4d02d-1741-4b40-9fee-147412ca63d2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.159904 Jun 03 11:59:03.950915 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 45/86] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:03 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:04.074168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:04.075008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:04.082158 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:04.082608 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:04.083493 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:04.083957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:04.118581 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:04.119485 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:04.133812 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:04.135757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:04.136807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:04.137586 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:04.231980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:04.236854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0d9ceb29-b2de-419c-a79c-842d8e721e9f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.167049 Jun 03 11:59:04.237418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:04 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:04.281463 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:04.288924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a7e49ce0-e2e6-4b9d-9f5d-8af08102f0d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.177791 Jun 03 11:59:04.289522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 46/88] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:04 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:04.968123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:04.968730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:04.975754 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:04.976972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:04.977913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:04.978499 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:05.163407 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:05.183885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:05.189037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:05.192748 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fedeae9f-d38e-4389-ad28-ec93405aceeb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.228907 Jun 03 11:59:05.193479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 43/89] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:04 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:05.254212 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:05.254822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:05.267080 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:05.272159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:05.274131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:05.280529 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:05.306025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:05.307176 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:05.322839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:05.323529 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:05.324674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:05.325163 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:05.529439 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:05.539480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-53b86f7e-0878-431b-bb0a-349bd350883a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.289185 Jun 03 11:59:05.550733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 47/90] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:05 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:05.599201 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:05.608082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-71c09b16-06ec-43ce-8a08-e73b663bc156 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.305910 Jun 03 11:59:05.608668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 44/91] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:05 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:06.212647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:06.213615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:06.222638 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:06.223790 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:06.225231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:06.226028 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:06.559667 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:06.560997 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:06.575710 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:06.576446 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:06.577535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:06.578236 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:06.936273 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:06.948744 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:06.950942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:06.952933 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8e35d337-2f79-4a39-87a7-f0e606eb5b2b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.745081 Jun 03 11:59:06.954010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 48/92] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:06 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:06.969674 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:06.970337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:06.999980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:07.003338 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:07.004329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:07.008466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:07.027913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:07.035882 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ee7d5799-38f4-48d0-b838-b4514b2e66ee tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.482145 Jun 03 11:59:07.041968 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 45/93] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:06 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:07.112698 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-3e848642-5e0c-4c16-883a-c83704abc1c7 req-464b8897-9be5-4fc3-a434-21d514bffced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ea1333-a55a-4e41-bef1-80263aa05089", "name": "network-vif-plugged", "status": "completed", "tag": "b1031a51-e343-44fb-8ae5-30c4f910486f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:07.124647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-3e848642-5e0c-4c16-883a-c83704abc1c7 req-464b8897-9be5-4fc3-a434-21d514bffced service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:07.125372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-3e848642-5e0c-4c16-883a-c83704abc1c7 req-464b8897-9be5-4fc3-a434-21d514bffced service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:07.147064 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-3e848642-5e0c-4c16-883a-c83704abc1c7 req-464b8897-9be5-4fc3-a434-21d514bffced service nova] Creating event network-vif-plugged:b1031a51-e343-44fb-8ae5-30c4f910486f for instance 40ea1333-a55a-4e41-bef1-80263aa05089 on hv-cinder-84457 Jun 03 11:59:07.155413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-3e848642-5e0c-4c16-883a-c83704abc1c7 req-464b8897-9be5-4fc3-a434-21d514bffced service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111931 Jun 03 11:59:07.156245 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 46/94] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:07.195877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:07.207041 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7240900f-e979-4f45-9009-b0128171163a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.251494 Jun 03 11:59:07.207718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 49/95] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:06 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:07.980688 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:07.982673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:07.993957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:07.995090 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:07.996375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:07.997085 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:08.052393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:08.052997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:08.064716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:08.065246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:08.066160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:08.066820 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:08.200370 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:08.212039 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:08.214223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:08.215863 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-42ac04c4-7934-4cbb-881e-933d7f3f709b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.244041 Jun 03 11:59:08.216725 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 47/96] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:07 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:59:08.235633 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:08.236795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:08.243931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:08.244721 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:08.245732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:08.246239 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:08.289148 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:08.301509 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-07e61b0e-8e9a-422b-bbdd-f39992c441c4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.251849 Jun 03 11:59:08.303682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 50/97] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:08 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:08.409299 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:08.431125 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5f3e6b32-454b-453d-8beb-df57fab98446 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.199665 Jun 03 11:59:08.432997 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 48/98] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:08 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:09.249301 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:09.250873 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:09.292597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:09.292597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:09.292597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:09.295633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:09.295633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:09.320248 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:09.320751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:09.336802 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:09.337812 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:09.338810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:09.339572 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:09.529068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:09.537849 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-99a0bf1d-355d-4463-a219-45ae762e943a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.221583 Jun 03 11:59:09.539696 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 49/99] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:09 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:09.546076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:09.546901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:09.554805 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:09.555373 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:09.556364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:09.557016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:09.731630 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:09.739643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-224d1057-f013-4773-9e8c-44ac1b6f3d15 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.198399 Jun 03 11:59:09.744243 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 50/100] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:09 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:09.814329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:09.828569 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:09.830071 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:09.831192 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aa717d8d-999e-4250-9e3f-7f846fa374b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.591359 Jun 03 11:59:09.846216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 51/101] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:09 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:10.560889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:10.563104 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:10.613168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:10.615923 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:10.618938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:10.622313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:10.762819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:10.763660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:10.790547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:10.791026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:10.792352 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:10.793512 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:10.799471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:10.809510 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7e0c0122-2edb-4e01-b773-c23aac0cb07c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.257005 Jun 03 11:59:10.810819 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:10 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:10.853497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:10.854364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:10.864210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:10.864849 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:10.869818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:10.870457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:11.074825 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:11.084464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-38699f75-c74b-4f14-9c2e-8c74f5595c17 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.327554 Jun 03 11:59:11.087175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 52/103] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:10 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:11.097607 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-04dbfcf6-9bcf-46d6-9659-1dfe4aea858f req-4a10bbab-3b08-4545-86a3-d9addedd403a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7dbfbf-015e-447d-96cd-5ab9efa88d62", "name": "network-vif-plugged", "status": "completed", "tag": "def82060-451f-48f0-9d78-a33f82670dc7"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:11.112869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:11.122040 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-04dbfcf6-9bcf-46d6-9659-1dfe4aea858f req-4a10bbab-3b08-4545-86a3-d9addedd403a service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:11.122498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-04dbfcf6-9bcf-46d6-9659-1dfe4aea858f req-4a10bbab-3b08-4545-86a3-d9addedd403a service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:11.123493 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:11.125129 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:11.126854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-faad9448-e2aa-4e91-b052-fd6e89133465 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.279988 Jun 03 11:59:11.131539 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 52/104] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:10 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:11.288296 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-04dbfcf6-9bcf-46d6-9659-1dfe4aea858f req-4a10bbab-3b08-4545-86a3-d9addedd403a service nova] Creating event network-vif-plugged:def82060-451f-48f0-9d78-a33f82670dc7 for instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 on hv-cinder-84457 Jun 03 11:59:11.293945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-04dbfcf6-9bcf-46d6-9659-1dfe4aea858f req-4a10bbab-3b08-4545-86a3-d9addedd403a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204962 Jun 03 11:59:11.294748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 53/105] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:11.826163 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:11.826770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:11.832694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:11.833140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:11.833871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:11.834301 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:12.104795 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:12.106151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:12.121181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:12.121752 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:12.122819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:12.123484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:12.152670 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.175463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:12.184884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4d95a7df-2184-4cdb-acc9-e61ea132df3c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.362403 Jun 03 11:59:12.185466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:11 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:12.199674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:12.201583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:12.210225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:12.211533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:12.213107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:12.213542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:12.288642 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:12.296639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d09da866-f4dd-40dc-8f77-bb4d4e5824f0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.196972 Jun 03 11:59:12.307172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:12 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:12.355974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:12.359874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=100 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.365928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:12.368149 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:12.369263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-31c07f69-5864-47f4-abfc-22e52a52cda3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.176394 Jun 03 11:59:12.369859 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 54/108] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:12 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:13.203885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:13.205688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:13.214907 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:13.215609 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:13.216632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:13.217429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:13.316155 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:13.317056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:13.330109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:13.330927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:13.332364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:13.333175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:13.423293 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:13.432906 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6a2692a9-4ce7-42a5-a9ae-bd14c55a4c9d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.234349 Jun 03 11:59:13.442627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 55/109] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:13 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:13.447612 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:13.448604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:13.455108 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:13.455858 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:13.457097 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:13.457636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:13.533387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:13.541620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cb347c80-11ee-4645-ae3e-f7e622b1f515 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.231397 Jun 03 11:59:13.542228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 55/110] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:13 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:13.625117 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:13.634053 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:13.635576 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:13.636862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c39ee59a-4ac1-43c1-9536-4436aae33e54 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.193032 Jun 03 11:59:13.637589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 56/111] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:13 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:14.450491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:14.451106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:14.457480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:14.457941 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:14.458774 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:14.459406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:14.558233 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:14.558869 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:14.565998 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:14.565998 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:14.566754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:14.568224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:14.604447 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:14.613418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5e9983f7-924f-4984-bc1c-5044d2d2c8e6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.167371 Jun 03 11:59:14.614694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 56/112] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:14 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:14.654690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:14.655290 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:14.664168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:14.664616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:14.665394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:14.676168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:14.751672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:14.765427 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3377bd8c-982b-4a21-9b52-2f41d68b5cfa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.210883 Jun 03 11:59:14.766121 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 57/113] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:14 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:14.849987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:14.858897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:14.860552 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:14.861876 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1b2384ea-e3de-4067-9c4c-f1fc02972713 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.210957 Jun 03 11:59:14.862555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 57/114] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:14 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:59:15.630988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:15.633230 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:15.639679 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:15.640124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:15.641105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:15.641540 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:15.786253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:15.786872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:15.797523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:15.797832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:15.798653 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:15.799084 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:15.861692 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:15.873559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a392cd99-dc31-4ea8-aae1-18da46920952 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.246656 Jun 03 11:59:15.874665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 58/115] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:15 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:15.886840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:15.887459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:15.906018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:15.906477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:15.907267 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:15.908221 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:16.136949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:16.145565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:16.147214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:16.149039 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1f81032c-9d47-4bb9-9578-be50fed50a7b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.266943 Jun 03 11:59:16.150103 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 59/116] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:15 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:16.209668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:16.221415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f48a343c-9f0b-4f86-b3f5-bdcc886f3986 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.440331 Jun 03 11:59:16.223546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 58/117] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:15 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:16.898988 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:16.900166 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-7fd5903c-b2f6-4456-9f1f-be586e08f153 req-06185c86-b6b7-4712-bdd3-16349f215b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "name": "network-vif-plugged", "status": "completed", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:16.900686 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:16.931068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:16.935767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:16.937065 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:16.938687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-7fd5903c-b2f6-4456-9f1f-be586e08f153 req-06185c86-b6b7-4712-bdd3-16349f215b6c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:16.939200 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-7fd5903c-b2f6-4456-9f1f-be586e08f153 req-06185c86-b6b7-4712-bdd3-16349f215b6c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:16.943551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:16.975166 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-7fd5903c-b2f6-4456-9f1f-be586e08f153 req-06185c86-b6b7-4712-bdd3-16349f215b6c service nova] Creating event network-vif-plugged:afce902f-86ce-4fca-bc6c-a632e1f83134 for instance a5e00459-a0d4-4520-bc60-02901fe74ffe on hv-cinder-84457 Jun 03 11:59:16.990621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-7fd5903c-b2f6-4456-9f1f-be586e08f153 req-06185c86-b6b7-4712-bdd3-16349f215b6c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098161 Jun 03 11:59:16.992063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 60/118] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:17.168405 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:17.169711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:17.170672 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:17.178989 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-dcd1364d-15d6-40ae-a1ac-3b3f1fedca0f tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.291119 Jun 03 11:59:17.180405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 59/119] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:16 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:17.187543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:17.188067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:17.188845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:17.189278 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:17.241055 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:17.242309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:17.250768 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:17.250768 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:17.250768 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:17.251015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:17.349240 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:17.357785 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:17.359651 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:17.360774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b117fd64-d384-4262-8286-9acf38bf8711 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.198042 Jun 03 11:59:17.361528 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 61/120] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:17 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 11:59:17.401708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:17.409679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-811de908-f984-4ca0-9cd6-bd0e6a945880 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.173437 Jun 03 11:59:17.410270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 60/121] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:17 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:18.204772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:18.205566 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:18.212811 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:18.213262 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:18.214252 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:18.214692 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:18.359895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:18.369147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8cc1231a-b88d-482b-a56a-232275b5c478 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1315 microversion: 2.1 time: 0.169794 Jun 03 11:59:18.370186 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 62/122] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:18 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:18.384482 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:18.385500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:18.391948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:18.392577 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:18.393528 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:18.394261 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:18.427741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:18.429167 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:18.454697 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:18.462116 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:18.465378 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:18.469493 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:18.732919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:18.747457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:18.749790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:18.751723 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f8fcf9ab-a4a0-4281-945c-93871ae1e353 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.375792 Jun 03 11:59:18.752979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 61/123] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:18 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:18.793361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:18.802988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0761c2f1-6271-4c79-a6c4-ad273f009f44 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.379107 Jun 03 11:59:18.811832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 63/124] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:18 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:19.019403 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-9befe76d-cfaf-48ee-aeb0-3e6014812fcc req-8137fd59-8e8a-4a73-b738-ed3ffbc2cee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773c52dc-848f-4fe8-bb42-02d7bce02898", "name": "network-vif-plugged", "status": "completed", "tag": "d2f7adff-2e38-430b-9551-404dd7ca8229"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:19.030337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-9befe76d-cfaf-48ee-aeb0-3e6014812fcc req-8137fd59-8e8a-4a73-b738-ed3ffbc2cee6 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.030865 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-9befe76d-cfaf-48ee-aeb0-3e6014812fcc req-8137fd59-8e8a-4a73-b738-ed3ffbc2cee6 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.050300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-9befe76d-cfaf-48ee-aeb0-3e6014812fcc req-8137fd59-8e8a-4a73-b738-ed3ffbc2cee6 service nova] Creating event network-vif-plugged:d2f7adff-2e38-430b-9551-404dd7ca8229 for instance 773c52dc-848f-4fe8-bb42-02d7bce02898 on hv-cinder-84457 Jun 03 11:59:19.056025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-9befe76d-cfaf-48ee-aeb0-3e6014812fcc req-8137fd59-8e8a-4a73-b738-ed3ffbc2cee6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040809 Jun 03 11:59:19.056609 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 62/125] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:19.387059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:19.388452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:19.394458 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.394895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.396009 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.396437 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.552777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:19.560956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-471b68c2-470d-46bb-ad63-a105bc6f131a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1502 microversion: 2.1 time: 0.177889 Jun 03 11:59:19.561523 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 64/126] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:19 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:19.770657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:19.771515 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:19.778500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.778948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.779739 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.780175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.818887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:19.819559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:19.828348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.829259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.830908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:19.831769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:19.971166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:19.983853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:19.985530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:19.986972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-32337547-ee87-47dd-a6be-cb97ec2da3e3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1406 microversion: 2.20 time: 0.220468 Jun 03 11:59:19.996226 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 63/127] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:19 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:20.099773 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:20.118588 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cc65fa27-363f-4190-b15f-cd9f7ba22e35 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.303687 Jun 03 11:59:20.120147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 65/128] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:19 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:21.006203 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:21.007659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:21.013860 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.014945 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.015745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.016178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.095663 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cdb5017-c991-49dc-9368-bde9423ddd1b"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:21.097462 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:21.106109 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.106713 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.108052 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.108793 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.176121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:21.185418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:21.186919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:21.188156 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3959c96f-e64d-4591-a3dd-99a73c7636e1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1599 microversion: 2.20 time: 0.185977 Jun 03 11:59:21.195767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 64/129] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 11:59:21 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 11:59:21.200914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:21.201611 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:21.212523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.213043 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.214170 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.215537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.372931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:21.380348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fa0be1bb-bb5a-4fd9-999b-087e19689dae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.190396 Jun 03 11:59:21.380909 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 65/130] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:21 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:21.385981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:21.386652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:21.393324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.393942 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.394864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:21.395517 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:21.636433 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1b5f20c3-0c33-4686-b304-a10cd43acdde tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.254300 Jun 03 11:59:21.642955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 66/131] 10.222.0.15 () {60 vars in 1315 bytes} [Fri Jun 3 11:59:21 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-interface => generated 285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 11:59:21.738545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d2c70bbe-0dc6-4c48-9fd6-3931ee108f1d tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "POST /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648008 Jun 03 11:59:21.747951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 66/132] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 11:59:21 2022] POST /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:22.398224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:22.400106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:22.408313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:22.408865 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:22.409864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:22.410527 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:22.901109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:22.927679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-de9feb1e-d7f8-47f6-9b6a-a3499da30f09 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1321 microversion: 2.1 time: 0.533572 Jun 03 11:59:22.928705 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 67/133] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:22 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:23.231599 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-d06d7807-46fb-4b8b-a565-7b71a6211ae8 req-22308a90-0596-46cb-a7c3-67668ea82192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:23.253954 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d06d7807-46fb-4b8b-a565-7b71a6211ae8 req-22308a90-0596-46cb-a7c3-67668ea82192 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:23.254411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d06d7807-46fb-4b8b-a565-7b71a6211ae8 req-22308a90-0596-46cb-a7c3-67668ea82192 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:23.276312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-d06d7807-46fb-4b8b-a565-7b71a6211ae8 req-22308a90-0596-46cb-a7c3-67668ea82192 service nova] Creating event network-changed:afce902f-86ce-4fca-bc6c-a632e1f83134 for instance a5e00459-a0d4-4520-bc60-02901fe74ffe on hv-cinder-84457 Jun 03 11:59:23.290216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-d06d7807-46fb-4b8b-a565-7b71a6211ae8 req-22308a90-0596-46cb-a7c3-67668ea82192 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063553 Jun 03 11:59:23.291561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 67/134] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:23.945959 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:23.946745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:23.958843 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:23.961339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:23.962236 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:23.962574 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:24.234482 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:24.243199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c4951f45-41e1-4224-96ce-7358e293f031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1514 microversion: 2.1 time: 0.301085 Jun 03 11:59:24.260060 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 68/135] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:23 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:24.266422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:24.267626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:24.279736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:24.280366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:24.281374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:24.282190 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:24.338931 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'flavor' on Instance uuid 773c52dc-848f-4fe8-bb42-02d7bce02898 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 11:59:24.610127 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-36c3fac3-a8d2-44ac-aa35-d9d4cab5d151 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898/action" status: 200 len: 32 microversion: 2.1 time: 0.348769 Jun 03 11:59:24.611847 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 68/136] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 11:59:24 2022] POST /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898/action => generated 32 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 11:59:24.622372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:24.623374 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:24.638563 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:24.639335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:24.640709 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:24.641347 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:24.934456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:24.955160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8f9da65b-0b9e-4d93-952a-871ada828492 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.337796 Jun 03 11:59:24.958508 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:24 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:25.977499 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:25.978180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:25.985354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:25.985804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:25.986615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:25.986989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:25.991478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:26.156927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:26.168633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9cca7145-27ed-48d8-969b-82d21e47d55e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.193425 Jun 03 11:59:26.168895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:25 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:26.550241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-523099598", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "networks": [{"uuid": "59434970-2747-44aa-97f5-fb17960436ad"}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:26.608057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] validate_networks() for [('59434970-2747-44aa-97f5-fb17960436ad', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 11:59:27.016080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 11:59:27.016720 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 11:59:27.018900 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 11:59:27.019832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 11:59:27.021096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 11:59:27.035977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:27.036693 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:27.037647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:27.038778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:27.057926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Getting quotas for project 75f93cd1b2a5494e933eedb3af0c283a. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 11:59:27.062009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Getting quotas for user c82999dd117a4335ae779cd92d45db4b and project 75f93cd1b2a5494e933eedb3af0c283a. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 11:59:27.073572 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 11:59:27.075875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 11:59:27.134983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f8608b08-d328-4d11-a2e9-74951ae4da5e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588667 Jun 03 11:59:27.136387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 70/139] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 11:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 11:59:27.148877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b2edb997-62af-4173-8bd0-398dda47b550 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:27.159594 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b2edb997-62af-4173-8bd0-398dda47b550 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:27.186212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:27.187789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:27.206785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:27.208179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:27.209070 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:27.209523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:27.259877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b2edb997-62af-4173-8bd0-398dda47b550 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:27.269395 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b2edb997-62af-4173-8bd0-398dda47b550 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1213 microversion: 2.1 time: 0.125060 Jun 03 11:59:27.270157 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:27 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:27.442395 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:27.457675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f416b072-3834-4206-8b45-4a7a485bd767 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.274466 Jun 03 11:59:27.462666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:27 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:28.287023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:28.288519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:28.295318 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=68 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.297220 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:28.297951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:28.298897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:28.300181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:28.398702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:28.411100 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6b2015f8-e602-4049-b92e-09449a159047 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1217 microversion: 2.1 time: 0.128169 Jun 03 11:59:28.412063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 71/142] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:28 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:28.480070 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:28.481363 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:28.484075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.494375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:28.495989 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:28.497073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:28.497516 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:28.664668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:28.673133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ae0884dc-3055-4a52-86ed-f6f7908a8130 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.197765 Jun 03 11:59:28.673866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 72/143] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:28 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:29.429111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:29.429722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:29.436705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:29.437384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:29.438361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:29.438869 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:29.517174 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:29.527926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-be53d8da-c358-46eb-8a77-3737b8d1f7a7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.103188 Jun 03 11:59:29.529384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 72/144] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:29 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:29.691119 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:29.693570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:29.701651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:29.702394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:29.703156 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:29.703914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:29.709339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=100 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:29.863001 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:29.871672 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3ba31836-282e-4e9d-88b6-0ee310cb3749 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.185335 Jun 03 11:59:29.872772 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 73/145] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:29 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:30.545141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:30.545753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:30.552432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:30.552880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:30.554036 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:30.554471 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:30.619169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:30.626941 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4e7ac67e-940f-43a5-bc1f-3992b33cb75f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.085574 Jun 03 11:59:30.627568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:30 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:30.890271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:30.890878 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:30.897042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:30.898492 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:30.899467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:30.900103 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:31.081081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:31.090228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ef058500-9337-4781-a347-ca5c9d0866fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.204046 Jun 03 11:59:31.090951 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 74/147] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:30 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:31.642623 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:31.643175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:31.649953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:31.650408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:31.651170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:31.651639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:31.712637 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:31.720098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1bdcda53-d38f-4a61-9908-cd715b2150b9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.081381 Jun 03 11:59:31.720662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:31 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:32.107080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:32.107718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:32.113620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:32.114063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:32.114814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:32.115240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:32.242063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:32.249383 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fa181d17-b3e3-447f-9ac9-27874742b2da tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.146073 Jun 03 11:59:32.249947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 75/149] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:32 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:32.737283 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:32.737854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:32.744836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:32.745280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:32.746032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:32.746462 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:32.807918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:32.815214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-75c99896-8897-4e8d-a315-9b20da7fed23 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.081845 Jun 03 11:59:32.815802 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:32 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:33.267087 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:33.268250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:33.274823 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:33.275443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:33.276231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:33.276660 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:33.403256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:33.410919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8d23f173-0dbf-4ff2-a790-96b39f398105 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.148688 Jun 03 11:59:33.411484 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:33 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:33.832379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:33.832991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:33.840139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:33.840584 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:33.841338 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:33.841770 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:33.904912 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:33.912169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e09b418c-8a22-4a96-bc51-611348507558 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.083632 Jun 03 11:59:33.912728 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 76/152] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:33 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:34.428954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:34.429511 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:34.435412 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:34.435883 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:34.436655 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:34.437082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:34.564229 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:34.571637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-baf14ba4-ca5a-411b-803f-97b208ce5353 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.147045 Jun 03 11:59:34.572320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:34 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:34.928701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:34.929315 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:34.935949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:34.936404 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:34.937160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:34.937597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:34.997452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:35.005170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e45789cd-f1e9-4bd3-9a74-c884a4bc00df tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.080406 Jun 03 11:59:35.005733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 77/154] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:34 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:35.588062 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:35.588661 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:35.594536 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:35.594970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:35.595733 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:35.596158 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:35.725965 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:35.733344 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-00fa7c4b-8830-4542-bcf2-8c7c749e4027 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.149079 Jun 03 11:59:35.733906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 78/155] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:35 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:36.022093 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:36.022964 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:36.029474 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:36.029923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:36.030679 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:36.031112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:36.090542 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:36.097761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b8c48921-f12c-4d1e-a154-9389275493c3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1209 microversion: 2.1 time: 0.079571 Jun 03 11:59:36.098311 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 78/156] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:36 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:36.750138 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:36.750928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:36.758183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:36.758624 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:36.759378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:36.759829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:36.887322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:36.895144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2707c2d6-7430-42ec-81e3-f97d5eee7dba tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.148928 Jun 03 11:59:36.895749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 79/157] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:36 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:37.114203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:37.114739 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:37.122028 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:37.122492 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:37.123249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:37.123727 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:37.193023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:37.200986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-87b4e07e-f89e-4f27-ad4c-93d7e78190a8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1265 microversion: 2.1 time: 0.090728 Jun 03 11:59:37.201546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 79/158] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:37 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:37.913469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:37.914952 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:37.917277 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:37.918180 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:37.931081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:37.932244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:37.933310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:37.934386 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.178536 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:38.187340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6b953eac-73c9-4bf6-8214-6f6fae04620f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.278147 Jun 03 11:59:38.196448 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 80/159] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:37 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:38.217872 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:38.218680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:38.220323 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:38.226706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:38.227154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.227957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:38.228395 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.307916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:38.316440 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-af9685d1-4486-4c1f-b05c-36cc3d2ae4c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1271 microversion: 2.1 time: 0.102542 Jun 03 11:59:38.317007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 80/160] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:38 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:38.507417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:38.508048 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:38.514428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:38.514971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.516114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:38.516541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.554697 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 11:59:38.680631 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c35eb78b-555a-41b1-b33d-0910c260bfae tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 204 len: 0 microversion: 2.1 time: 0.176856 Jun 03 11:59:38.683714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 11:59:38 2022] DELETE /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 11:59:38.693375 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:38.694178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:38.705159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:38.707973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.708957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:38.709529 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:38.939460 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:38.948058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-900e8be7-6005-4bbd-b876-ef73eee4f204 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.261750 Jun 03 11:59:38.957570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:38 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:39.204782 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:39.205488 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:39.212614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:39.213063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:39.213814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:39.214247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:39.333448 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:39.334142 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:39.341534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:39.343225 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:39.343708 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:39.344458 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:39.344886 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:39.349216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c860b877-cfd8-48bb-9edf-967c2a857738 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.148649 Jun 03 11:59:39.349793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:39 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:39.476412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:39.483674 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2b8b386d-ea76-44a0-a082-1a3b81f2e9bd tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.154073 Jun 03 11:59:39.484228 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:39 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:39.965503 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:39.966131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:39.972138 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:39.972541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:39.973260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:39.973683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:40.104006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:40.111854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3a43e700-baef-4ff3-92e5-1be4ab6c3c49 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.150185 Jun 03 11:59:40.112415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:39 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:40.366027 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:40.367140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:40.373647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:40.374091 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:40.374840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:40.375273 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:40.502021 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:40.502718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:40.505862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:40.509278 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:40.509795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:40.510608 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:40.511100 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:40.513197 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0b4d0718-a1f1-4b7e-b061-a037da025ce7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.150989 Jun 03 11:59:40.513765 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:40 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:40.638486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:40.646426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-00a1d44f-9034-4a52-9e99-26c2b161c89b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.148107 Jun 03 11:59:40.647009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 84/167] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:40 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:41.129120 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:41.129714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:41.136313 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:41.136754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:41.137493 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:41.137916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:41.266647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:41.275472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-295fc8db-8453-4eec-bda9-a6eb09fcb0a1 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.150182 Jun 03 11:59:41.276047 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:41 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:41.530072 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:41.530681 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:41.536699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:41.537139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:41.537884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:41.538316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:41.663191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:41.664596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:41.667088 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:41.671208 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:41.671711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:41.672476 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:41.672915 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:41.674507 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-776d47f3-7e96-4871-b6c3-9a15504ad587 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.148231 Jun 03 11:59:41.675064 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 85/169] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:41 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:41.804935 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:41.812218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-442840a3-e471-49ed-bf1f-261838891b57 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.152864 Jun 03 11:59:41.812767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 85/170] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:41 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:42.292389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:42.292991 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:42.298908 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:42.299355 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:42.300139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:42.300570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:42.428801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:42.437147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-22e36a2e-c553-4b8b-80f6-ab76b180084a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.148556 Jun 03 11:59:42.437715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 86/171] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:42 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:42.691656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:42.692199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:42.698569 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:42.699015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:42.699796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:42.700232 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:42.828776 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:42.829479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:42.832215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:42.835602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:42.835895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:42.836341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:42.837260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:42.837621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:42.840152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-764b3595-4d46-4179-bb84-3a9a029d7603 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.152391 Jun 03 11:59:42.840714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:42 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:42.966526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:42.973996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7f6dcf7e-fb1d-4280-8712-f6d28b340a31 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.149083 Jun 03 11:59:42.974555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 87/173] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:42 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:43.454152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:43.454788 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:43.460912 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:43.461356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:43.462106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:43.462541 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:43.594759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:43.603131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-201c698d-95f5-4333-8d81-0b47367c3957 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.153165 Jun 03 11:59:43.603724 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 87/174] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:43 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:43.857480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:43.858083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:43.864120 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:43.864556 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:43.865290 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:43.865713 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:43.869869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:43.989981 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:43.990609 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:43.997210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:43.997654 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:43.998411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:44.001190 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:44.010570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:44.018122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-efb470f8-090d-46c7-842d-3b8cea9388a0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.164496 Jun 03 11:59:44.018775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:43 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:44.129134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:44.137371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f9daa607-306c-4d77-9d36-45696687bb8c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.151164 Jun 03 11:59:44.139103 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 88/176] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:43 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:44.620341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:44.620955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:44.626967 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:44.627410 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:44.628191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:44.628623 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:44.758359 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:44.766260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5973ae47-6843-481d-a46a-a5af382bfd7b tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.150223 Jun 03 11:59:44.766821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:44 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:45.035630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:45.036250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:45.043210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.043701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.044453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.044879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.154530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:45.155305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:45.165693 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.166399 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.167418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.168050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.268480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:45.278900 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d5fa19a2-46be-4cc4-98a1-4ac22cf51c77 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.247033 Jun 03 11:59:45.280178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 89/178] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:45 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:45.298151 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:45.305750 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9129f7a6-1525-48dd-a38e-55ea86d737b7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.155127 Jun 03 11:59:45.306323 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 90/179] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:45 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:45.589511 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-16c29bc3-0b2a-4369-a6bc-daa04ff83f73 req-49a4b53b-4761-42de-8513-afeb28d0e4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8583bb42-98c6-404a-ae88-b8a6be2814c5", "tag": "d99c3e7e-c2fe-49c8-a092-9d22e94d7c39"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:45.600032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-16c29bc3-0b2a-4369-a6bc-daa04ff83f73 req-49a4b53b-4761-42de-8513-afeb28d0e4aa service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.602023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-16c29bc3-0b2a-4369-a6bc-daa04ff83f73 req-49a4b53b-4761-42de-8513-afeb28d0e4aa service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.613228 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-16c29bc3-0b2a-4369-a6bc-daa04ff83f73 req-49a4b53b-4761-42de-8513-afeb28d0e4aa service nova] Creating event network-changed:d99c3e7e-c2fe-49c8-a092-9d22e94d7c39 for instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 on hv-cinder-84457 Jun 03 11:59:45.617998 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-16c29bc3-0b2a-4369-a6bc-daa04ff83f73 req-49a4b53b-4761-42de-8513-afeb28d0e4aa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033096 Jun 03 11:59:45.618568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 90/180] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:45.783275 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:45.783879 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:45.789824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.790271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.791018 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:45.791445 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:45.928287 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:45.936439 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c5c23bfb-c242-4a98-878e-30da6ffbac9a tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.157069 Jun 03 11:59:45.937005 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 91/181] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:45 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:46.297753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:46.298385 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:46.305986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:46.306429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:46.307191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:46.307645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:46.322724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:46.323329 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:46.329502 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:46.330014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:46.330770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:46.331282 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:46.465464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:46.475295 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:46.477453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d40357e4-0655-430b-a201-23a81b32a8ae tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.184373 Jun 03 11:59:46.478067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:46 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:46.484781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d8da2bdd-97c5-41b8-a618-831a2347772a tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.166509 Jun 03 11:59:46.485339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:46 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:46.954151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:46.954759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:46.961289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:46.961735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:46.962522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:46.962991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:47.098746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:47.109841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-82975e4f-f0be-4d27-a939-17e0b4c73cde tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1554 microversion: 2.1 time: 0.159448 Jun 03 11:59:47.113896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 92/184] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:46 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:47.506035 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:47.507256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:47.509118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:47.510398 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:47.524316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:47.524764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:47.525666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:47.526102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:47.529725 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:47.530170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:47.530955 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:47.531404 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:47.687702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:47.695785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8fba1372-6d35-42ae-bb47-79f190ecd72e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.204837 Jun 03 11:59:47.696351 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 93/185] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:47 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:47.765172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:47.773368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1f9c91ff-5886-4f10-a28e-50d6083db3c1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.274811 Jun 03 11:59:47.773931 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 93/186] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:47 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:48.096919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-39a35435-dab7-471d-95b9-a871ad3b6be7 req-f83c9c02-3ebb-48aa-8735-235eba9e60f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ea1333-a55a-4e41-bef1-80263aa05089", "name": "network-vif-deleted", "tag": "b1031a51-e343-44fb-8ae5-30c4f910486f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:48.105534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-39a35435-dab7-471d-95b9-a871ad3b6be7 req-f83c9c02-3ebb-48aa-8735-235eba9e60f3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.105966 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-39a35435-dab7-471d-95b9-a871ad3b6be7 req-f83c9c02-3ebb-48aa-8735-235eba9e60f3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.116547 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-39a35435-dab7-471d-95b9-a871ad3b6be7 req-f83c9c02-3ebb-48aa-8735-235eba9e60f3 service nova] Creating event network-vif-deleted:b1031a51-e343-44fb-8ae5-30c4f910486f for instance 40ea1333-a55a-4e41-bef1-80263aa05089 on hv-cinder-84457 Jun 03 11:59:48.122160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-39a35435-dab7-471d-95b9-a871ad3b6be7 req-f83c9c02-3ebb-48aa-8735-235eba9e60f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028966 Jun 03 11:59:48.122770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 94/187] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 11:59:48.130183 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:48.130786 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:48.136753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.137191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.137939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.138363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.201105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:48.209305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-978c573e-c0ad-45e4-b92e-6f119202c9e2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1512 microversion: 2.1 time: 0.082875 Jun 03 11:59:48.209934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 94/188] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:48 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:48.713767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:48.714465 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:48.720853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.721302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.722052 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.722479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.790600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:48.791211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:48.798684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.799130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.799925 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:48.800382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:48.862289 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:48.872861 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e946c7dc-3420-4666-86cf-e0393126989c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.163626 Jun 03 11:59:48.873489 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 95/189] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:48 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:48.965393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:48.973473 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c8ab9faa-6de1-432b-86e0-fb4aee975386 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.187232 Jun 03 11:59:48.974042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 95/190] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:48 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:49.228914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:49.229411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:49.235892 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:49.236345 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:49.237110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:49.237542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:49.306640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:49.314694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cfa1768d-62f1-464c-9a01-d178bc74d902 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1512 microversion: 2.1 time: 0.091850 Jun 03 11:59:49.315256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 96/191] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:49 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1512 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:49.890111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:49.891273 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:49.898795 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:49.899457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:49.900436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:49.901029 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:49.990539 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:49.991935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:50.001075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:50.006122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:50.007044 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:50.007645 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:50.180047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:50.187944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-17db68b7-d6b4-4d0f-8420-29c098be83d5 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.201591 Jun 03 11:59:50.188522 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 97/192] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:49 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:50.310005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:50.324479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b5ace5d3-dcfb-49b0-8240-fe3f0aacb031 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.438349 Jun 03 11:59:50.325936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 96/193] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:49 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:50.332638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:50.333252 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:50.340415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:50.341070 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:50.341996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:50.342640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:50.450789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:50.461593 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-666aee11-2c87-48d6-8958-d37e541c4e12 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.132940 Jun 03 11:59:50.472003 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 98/194] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:50 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:51.206118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:51.206769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:51.214265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:51.214704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:51.215457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:51.215905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:51.342894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:51.343690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:51.353723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:51.354013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:51.354591 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:51.357260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:51.357873 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:51.368903 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-77067e4b-6171-4f39-abf3-2066fdecc031 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.166651 Jun 03 11:59:51.370114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 97/195] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:51 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:51.478584 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:51.479241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:51.485816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:51.486699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:51.487777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:51.488249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:51.514876 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:51.531094 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-810d21a8-bb68-4bac-bacc-bab041a021f2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.192192 Jun 03 11:59:51.531798 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 99/196] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:51 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:51.568797 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:51.577144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72c0b1b6-6285-41a7-b88e-ed1478aaaf93 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.102901 Jun 03 11:59:51.578224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 98/197] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:51 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:52.385896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:52.386530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:52.392779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:52.393228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:52.393982 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:52.394415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:52.527793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:52.535271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-21bd9f50-9146-413a-a637-1ce5ebc23fba tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.153198 Jun 03 11:59:52.535963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 100/198] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:52 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:52.550051 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:52.550857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:52.557883 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:52.558323 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:52.559074 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:52.559512 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:52.596577 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:52.597411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:52.604937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:52.605737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:52.606796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:52.607385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:52.677683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:52.687157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0994ebbf-7b2a-4d37-a004-80b3a35e3379 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.095109 Jun 03 11:59:52.697025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 101/199] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:52 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:52.718246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:52.727840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b34008ab-ea69-4fee-bb1f-1cad3747bcbd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.181558 Jun 03 11:59:52.728478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 99/200] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:52 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:53.554303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:53.556308 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:53.563366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:53.563933 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:53.564899 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:53.565535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:53.703960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:53.704565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:53.711561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:53.712325 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:53.713411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:53.713869 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:53.740423 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:53.752493 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-062c0144-4b3f-489c-945a-876ffc441700 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.202499 Jun 03 11:59:53.757353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 102/201] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:53 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:53.766470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:53.766470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:53.773608 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:53.774316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:53.775151 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:53.775733 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:53.816456 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:53.834400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-81560c79-eac8-4901-b793-a43bccf275c2 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.131630 Jun 03 11:59:53.835375 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 100/202] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:53 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:53.924154 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:53.931524 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-063401f6-1278-455e-835e-07a9b63610d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.172050 Jun 03 11:59:53.932089 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 103/203] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:53 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:54.775552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:54.776172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:54.782675 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:54.783124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:54.783919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:54.784355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:54.852147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:54.853507 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:54.860397 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:54.861175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:54.862316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:54.863266 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:54.928368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:54.938746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2af7ac0a-4543-4988-b904-5aa31f72c159 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.168068 Jun 03 11:59:54.940494 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 101/204] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:54 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:54.951656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:54.953355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:54.954626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:54.961255 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:54.961704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:54.962467 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:54.962901 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:54.963110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9150697e-23a0-4008-aef4-6040227356a6 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.115697 Jun 03 11:59:54.963884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 104/205] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:54 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:55.105930 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:55.113359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-14face0e-7e3e-49bb-a9d0-fbd13bebfeda tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.169118 Jun 03 11:59:55.113922 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 102/206] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:54 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:55.955753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:55.956433 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:55.963191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:55.963658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:55.964405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:55.964835 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:55.981632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:55.982271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:55.984178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=100 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:55.991836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:55.992300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:55.993090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:55.993521 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:56.056186 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:56.064018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-25b4b5ed-ecd0-44e5-993c-577d17713155 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.086579 Jun 03 11:59:56.064578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 103/207] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:55 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:56.096815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:56.104818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-60b3ec7a-e89c-4329-a1e8-4ba0f4f06fa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.153024 Jun 03 11:59:56.105375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 105/208] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:55 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:56.130072 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:56.130669 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:56.137124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:56.137562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:56.138302 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:56.138726 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:56.142716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:56.267566 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:56.275856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-83593ae2-a5ce-4458-983e-7594def1a791 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.149469 Jun 03 11:59:56.276400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 104/209] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:56 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:57.080186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:57.080884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:57.087794 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:57.088237 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:57.088994 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:57.089426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:57.121547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:57.122152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:57.128640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:57.129084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:57.129834 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:57.130446 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:57.150887 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:57.158860 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0c37af3b-bb73-4d13-ba11-bdc450ecb178 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.082482 Jun 03 11:59:57.159424 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 106/210] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:57 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:57.266947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:57.275263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-68ce9081-f3d2-4c43-ad5e-2f8e657cec0b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.157681 Jun 03 11:59:57.275840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 105/211] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:57 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 11:59:57.292303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:57.292902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:57.298804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:57.299179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:57.300090 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:57.300362 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:57.427165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:57.435001 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e9c29768-ee0e-4172-b56e-9c35b1f56aff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.146461 Jun 03 11:59:57.435583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:57 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:58.175025 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:58.175759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:58.182967 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.183420 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.184236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.184901 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.255861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:58.270314 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6d6d1b0c-99b0-49d5-81fe-3d6b9914308c tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1346 microversion: 2.1 time: 0.098919 Jun 03 11:59:58.271350 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:58 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:58.291452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:58.292094 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:58.298291 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.299084 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.299880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.300314 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.404032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-3a5e22e8-a128-40dd-b294-fb9639c1e531 req-2c43a5ff-b15e-4552-89c7-e5a76d81bbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8583bb42-98c6-404a-ae88-b8a6be2814c5", "name": "network-vif-plugged", "status": "completed", "tag": "d99c3e7e-c2fe-49c8-a092-9d22e94d7c39"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 11:59:58.408639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=72 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:58.415640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-3a5e22e8-a128-40dd-b294-fb9639c1e531 req-2c43a5ff-b15e-4552-89c7-e5a76d81bbae service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.416179 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-3a5e22e8-a128-40dd-b294-fb9639c1e531 req-2c43a5ff-b15e-4552-89c7-e5a76d81bbae service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.428025 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-3a5e22e8-a128-40dd-b294-fb9639c1e531 req-2c43a5ff-b15e-4552-89c7-e5a76d81bbae service nova] Creating event network-vif-plugged:d99c3e7e-c2fe-49c8-a092-9d22e94d7c39 for instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 on hv-cinder-84457 Jun 03 11:59:58.433782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-3a5e22e8-a128-40dd-b294-fb9639c1e531 req-2c43a5ff-b15e-4552-89c7-e5a76d81bbae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034187 Jun 03 11:59:58.434457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 107/214] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 11:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 11:59:58.450436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:58.453852 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:58.454545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:58.459382 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-11195a57-cb2a-4ec1-8fbd-5c433a880eaa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.171578 Jun 03 11:59:58.463020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.463475 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.464314 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:58.464750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:58.468974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 108/215] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:58 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:58.595393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:58.603309 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-649bb122-9815-4b10-8a27-2678f3fab982 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.154064 Jun 03 11:59:58.603895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 108/216] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:58 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:59.289080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:59.289588 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:59.291486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:59.296783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.297257 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.298005 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.298467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.329552 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.329986 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.330449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lazy-loading 'fault' on Instance uuid 40ea1333-a55a-4e41-bef1-80263aa05089 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 11:59:59.373420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1d264439b340c3af56cad54b7bc4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10936ccaf444728a01afc3f374e2285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:59.381311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cdc36e7d-a249-4041-bce8-a348b52667b7 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 200 len: 1351 microversion: 2.1 time: 0.096116 Jun 03 11:59:59.381896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 109/217] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:59 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:59.478578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:59.479295 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:59.488645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.489242 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.490113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.490718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.621974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 11:59:59.622780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 11:59:59.630951 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.631747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.633312 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 11:59:59.633895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 11:59:59.720807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:59.728513 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c4de6867-8961-4645-88de-faffaaef2aa8 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.256439 Jun 03 11:59:59.729078 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 109/218] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:59 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 11:59:59.783450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 11:59:59.791046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c7c04f5a-a40d-4e2b-a8a9-7df08dac62bc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.174348 Jun 03 11:59:59.791638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 110/219] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 11:59:59 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:00.399750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:00.400387 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:00.406614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.407049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.407832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.408258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.422185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] HTTP exception thrown: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Request method failure captured: Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 HTTP/1.1 Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdkh0dEPOnpYXUDgjYrDTeLsKUUrM3OVsa0sXOb47br93bHL1YuiUWnR90iBpOxGj8xRKeQQR9vIJs-LfRGr_qt2wIDsGvkHAHbTjOtk4NWCGWDk_Mu7a1c_hmZfn666soaiG1osI9vPIJ6N1KMjnmBDR-paUhrw4maPDgAwy2ypCg Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:00:00.426877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d10936ccaf444728a01afc3f374e2285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d10936ccaf444728a01afc3f374e2285"}]}] Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 8e1d264439b340c3af56cad54b7bc4a4 Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.428957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '40ea1333-a55a-4e41-bef1-80263aa05089'} Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:00.429754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.431113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.432608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Returning 404 to user: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:00.432608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9329faef-3247-4145-aaf4-55aaf062baa9 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 404 len: 111 microversion: 2.1 time: 0.033227 Jun 03 12:00:00.432608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 110/220] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:00 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:00:00.530277 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:00.531792 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:00.537875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.538310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.539126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.539570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.553063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] HTTP exception thrown: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Request method failure captured: Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089/os-volume_attachments HTTP/1.1 Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdkh0dEPOnpYXUDgjYrDTeLsKUUrM3OVsa0sXOb47br93bHL1YuiUWnR90iBpOxGj8xRKeQQR9vIJs-LfRGr_qt2wIDsGvkHAHbTjOtk4NWCGWDk_Mu7a1c_hmZfn666soaiG1osI9vPIJ6N1KMjnmBDR-paUhrw4maPDgAwy2ypCg Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:00:00.557711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d10936ccaf444728a01afc3f374e2285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d10936ccaf444728a01afc3f374e2285"}]}] Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 8e1d264439b340c3af56cad54b7bc4a4 Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.559116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'server_id': '40ea1333-a55a-4e41-bef1-80263aa05089'} Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:00.559915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:00.561160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:00.562463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Returning 404 to user: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:00.562463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a5680411-47d6-46f6-81e5-b00c6e2b9cb4 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032898 Jun 03 12:00:00.562463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 111/221] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:00:00 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:00:00.745949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:00.746560 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:00.753637 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.754114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.755089 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.755545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.808547 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:00.809153 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:00.815184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.815660 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.816409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:00.816844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:00.887389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:00.902244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9571e979-d962-439f-b54d-c99ed69e2950 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.160619 Jun 03 12:00:00.902814 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 111/222] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:00 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:00.947739 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:00.955062 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5820415f-c722-4cad-9ae6-8452ea6fddb1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.150995 Jun 03 12:00:00.955643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 112/223] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:00 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:01.919351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:01.919989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:01.926476 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:01.926921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:01.927702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:01.928137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:01.972082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:01.972877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:01.980265 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:01.980778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:01.981610 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:01.982118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:02.073888 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:02.081778 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-39c89c37-d284-41c0-9ec3-117cd6fd2ee1 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.166085 Jun 03 12:00:02.082345 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 112/224] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:01 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:02.119075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:02.126554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a1892540-24e3-4145-981a-a98c81f7f560 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.158376 Jun 03 12:00:02.127098 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 113/225] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:01 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:03.098382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:03.099003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:03.106496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:03.106942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:03.107730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:03.108169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:03.143743 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:03.144461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:03.150972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:03.151423 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:03.152254 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:03.152682 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:03.239459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:03.247678 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-83a1ce61-ac5d-45e4-a416-0f84b3cb2546 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.153100 Jun 03 12:00:03.248241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 113/226] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:03 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:03.282481 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:03.291172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-781b5f1b-7061-4217-b68b-12eff854b9b0 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.151309 Jun 03 12:00:03.291758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 114/227] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:03 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:04.264184 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:04.264808 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:04.271726 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.272432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.273187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.273615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.309846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:04.310454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:04.316507 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.316953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.317719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.318159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.403383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:04.410995 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-851925e4-6955-4f67-8074-17ea24bbcea9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1313 microversion: 2.1 time: 0.150614 Jun 03 12:00:04.411572 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 114/228] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:04 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:04.448309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:04.455752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-092cc94a-e0ca-4514-b97e-ee3705ed0819 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.149939 Jun 03 12:00:04.456311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 115/229] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:04 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:04.893980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:04.894478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:04.901376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.902054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.902978 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.903770 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.918239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] HTTP exception thrown: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Request method failure captured: Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 HTTP/1.1 Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdkh0dEPOnpYXUDgjYrDTeLsKUUrM3OVsa0sXOb47br93bHL1YuiUWnR90iBpOxGj8xRKeQQR9vIJs-LfRGr_qt2wIDsGvkHAHbTjOtk4NWCGWDk_Mu7a1c_hmZfn666soaiG1osI9vPIJ6N1KMjnmBDR-paUhrw4maPDgAwy2ypCg Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:00:04.919809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d10936ccaf444728a01afc3f374e2285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d10936ccaf444728a01afc3f374e2285"}]}] Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 8e1d264439b340c3af56cad54b7bc4a4 Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.921211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '40ea1333-a55a-4e41-bef1-80263aa05089'} Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:04.922213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.925059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.927693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Returning 404 to user: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:04.927693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-459e9066-bf38-4ec4-8841-c09b81eac9b0 tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "DELETE /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 404 len: 111 microversion: 2.1 time: 0.031120 Jun 03 12:00:04.927693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 115/230] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:00:04 2022] DELETE /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:00:04.931758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:04.932542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] [instance: 40ea1333-a55a-4e41-bef1-80263aa05089] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:04.938871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.939415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.940283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:04.940805 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:04.954011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] HTTP exception thrown: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Request method failure captured: Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 HTTP/1.1 Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdkh0dEPOnpYXUDgjYrDTeLsKUUrM3OVsa0sXOb47br93bHL1YuiUWnR90iBpOxGj8xRKeQQR9vIJs-LfRGr_qt2wIDsGvkHAHbTjOtk4NWCGWDk_Mu7a1c_hmZfn666soaiG1osI9vPIJ6N1KMjnmBDR-paUhrw4maPDgAwy2ypCg Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:00:04.956240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d10936ccaf444728a01afc3f374e2285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d10936ccaf444728a01afc3f374e2285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d10936ccaf444728a01afc3f374e2285"}]}] Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: d10936ccaf444728a01afc3f374e2285 Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-DeleteServersTestJSON-670225613 Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 8e1d264439b340c3af56cad54b7bc4a4 Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-DeleteServersTestJSON-670225613-project Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.957747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '40ea1333-a55a-4e41-bef1-80263aa05089'} Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:04.958602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. Jun 03 12:00:04.959978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:04.961756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] Returning 404 to user: Instance 40ea1333-a55a-4e41-bef1-80263aa05089 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:04.961756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e8c3d033-7b99-4447-a488-5a44a07f648e tempest-DeleteServersTestJSON-670225613 tempest-DeleteServersTestJSON-670225613-project] 10.222.0.15 "GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089" status: 404 len: 111 microversion: 2.1 time: 0.032118 Jun 03 12:00:04.963366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 116/231] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:04 2022] GET /compute/v2.1/servers/40ea1333-a55a-4e41-bef1-80263aa05089 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:00:05.428365 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:05.428993 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:05.439298 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:05.439787 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:05.440552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:05.440982 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:05.471869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:05.472475 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:05.481271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:05.481652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:05.482421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:05.482851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:05.612944 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:05.626178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-88334fdb-8f13-45d9-a5e0-d62329f30d8e tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1496 microversion: 2.1 time: 0.201732 Jun 03 12:00:05.628740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 116/232] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:05 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1496 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:06.017671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:06.030842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bfdb4524-fbb7-46e8-b724-e594b710bd8e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1520 microversion: 2.1 time: 0.562347 Jun 03 12:00:06.031459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 117/233] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:05 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:06.503000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:06.503481 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:06.513795 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:06.518879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:06.519772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:06.521408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:06.582717 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:00:06.731469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8b6b442f-8ffd-4043-af8c-0a15e6db3593 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 204 len: 0 microversion: 2.1 time: 0.233711 Jun 03 12:00:06.732392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:00:06 2022] DELETE /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:00:06.741877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:06.743047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:06.751047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:06.751371 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:06.752788 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:06.753629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:06.921049 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:06.931266 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b6ea45b7-0400-4313-aaa1-63d7687d8eb0 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1502 microversion: 2.1 time: 0.193641 Jun 03 12:00:06.941077 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 118/235] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:06 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:07.051635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:07.052995 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:07.068018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:07.068896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:07.070955 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:07.084373 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:07.307475 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:07.317761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1909bd30-96cd-42f8-a0df-3ac2c6d5892e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1500 microversion: 2.1 time: 0.272966 Jun 03 12:00:07.319051 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 118/236] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:07 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:07.336438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:07.337923 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:07.347491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:07.348266 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:07.351587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:07.352293 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:07.586353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:07.600220 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f636dba1-3146-4216-ba7c-3992058d8d7c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1515 microversion: 2.1 time: 0.268159 Jun 03 12:00:07.601431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 119/237] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:07 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:07.949423 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:07.950917 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:07.961447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:07.966227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:07.967240 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:07.972480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:08.193457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:08.202829 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-36ff75d3-d852-4c3a-a824-13f800d82e99 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1502 microversion: 2.1 time: 0.258293 Jun 03 12:00:08.204118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:07 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:09.221434 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:09.222030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:09.232804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:09.233624 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:09.234647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:09.235231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:09.501462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:09.516048 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fd6cacc8-3b05-454f-9ba5-55ec1ea44fbf tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1502 microversion: 2.1 time: 0.295616 Jun 03 12:00:09.518567 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 120/239] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:09 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1502 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:09.764831 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-8c6c2e98-e4e7-45bb-a35e-774221363b60 req-181926d1-1578-497b-b9af-bb5de9fa3c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8583bb42-98c6-404a-ae88-b8a6be2814c5", "name": "network-vif-deleted", "tag": "d99c3e7e-c2fe-49c8-a092-9d22e94d7c39"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:09.774086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-8c6c2e98-e4e7-45bb-a35e-774221363b60 req-181926d1-1578-497b-b9af-bb5de9fa3c1e service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:09.774507 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-8c6c2e98-e4e7-45bb-a35e-774221363b60 req-181926d1-1578-497b-b9af-bb5de9fa3c1e service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:09.793001 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-8c6c2e98-e4e7-45bb-a35e-774221363b60 req-181926d1-1578-497b-b9af-bb5de9fa3c1e service nova] Creating event network-vif-deleted:d99c3e7e-c2fe-49c8-a092-9d22e94d7c39 for instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 on hv-cinder-84457 Jun 03 12:00:09.798769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-8c6c2e98-e4e7-45bb-a35e-774221363b60 req-181926d1-1578-497b-b9af-bb5de9fa3c1e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037796 Jun 03 12:00:09.799636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 120/240] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:10.169699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:10.170957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:10.191546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.192289 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.194063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.194807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.252208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'flavor' on Instance uuid cb7dbfbf-015e-447d-96cd-5ab9efa88d62 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:00:10.450878 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:10.536073 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:10.536828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:10.544125 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-efbc945f-c0be-4997-b033-a1260929ce21 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/action" status: 200 len: 32 microversion: 2.1 time: 0.381298 Jun 03 12:00:10.550106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 121/241] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:00:10 2022] POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:00:10.559062 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:10.561268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.564133 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.565125 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.567257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.568398 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:10.583107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.592738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.593718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.594152 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.670060 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:10.670800 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:10.671455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lazy-loading 'fault' on Instance uuid 8583bb42-98c6-404a-ae88-b8a6be2814c5 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:00:10.680989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:10.897480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:10.911884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:10.912990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-49081da5-2ec2-4093-8939-6b33003a79c2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 200 len: 1303 microversion: 2.1 time: 0.380958 Jun 03 12:00:10.915029 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 121/242] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:10 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 1303 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:10.929694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a5d2acf3-6bef-4009-8f50-90c388e3c817 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.377395 Jun 03 12:00:10.935983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 122/243] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:10 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:11.944070 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:11.946741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: 8583bb42-98c6-404a-ae88-b8a6be2814c5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:11.953625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:11.954234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:11.959110 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:11.962251 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:11.962700 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:11.963162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:11.963461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:11.965015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:11.966038 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:11.969675 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:11.998172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] HTTP exception thrown: Instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 could not be found. Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Request method failure captured: Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 HTTP/1.1 Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfeccR7Xn4K2RJmWu5Iy6KGNMrQM1ltcVVBtaCPovwPypvlbSiDz_OcHh_y2uVWyqL8Gg5l_sMFFAmzKr-lLGnFj93MmbW44NeHzUeZ6iXNDmoz7f0PlmRbaGGavapqYewYYeSh_LWZDm3oXBy1DfaJCVarDrk9UNlE0lD4FmmJA4HM Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 75f93cd1b2a5494e933eedb3af0c283a Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesActionsTest-35022083 Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:00:12.012469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/75f93cd1b2a5494e933eedb3af0c283a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_75f93cd1b2a5494e933eedb3af0c283a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/75f93cd1b2a5494e933eedb3af0c283a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/75f93cd1b2a5494e933eedb3af0c283a"}]}] Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesActionsTest-35022083 Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 75f93cd1b2a5494e933eedb3af0c283a Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesActionsTest-35022083 Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesActionsTest-35022083-project Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: c82999dd117a4335ae779cd92d45db4b Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesActionsTest-35022083-project Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 could not be found. Jun 03 12:00:12.013892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '8583bb42-98c6-404a-ae88-b8a6be2814c5'} Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 could not be found. Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:12.014718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 could not be found. Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 could not be found. Jun 03 12:00:12.016054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:00:12.017590 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Returning 404 to user: Instance 8583bb42-98c6-404a-ae88-b8a6be2814c5 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:12.019185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c82e8bc3-a68c-4b23-87a5-17616c331fb3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5" status: 404 len: 111 microversion: 2.1 time: 0.091406 Jun 03 12:00:12.020134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 122/244] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:11 2022] GET /compute/v2.1/servers/8583bb42-98c6-404a-ae88-b8a6be2814c5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:00:12.188635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1096459601", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "networks": [{"uuid": "59434970-2747-44aa-97f5-fb17960436ad"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:12.332991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] validate_networks() for [('59434970-2747-44aa-97f5-fb17960436ad', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:00:12.363987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:12.375474 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-629b53e1-7331-40f4-8ed3-90d471c55d31 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.425576 Jun 03 12:00:12.386641 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 123/245] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:11 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:13.399994 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:13.401627 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:13.413036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:13.413598 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:13.414597 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:13.415240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:13.522519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:00:13.523495 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:00:13.523940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:00:13.524361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:00:13.524851 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:00:13.533846 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:13.534551 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:13.535545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:13.536150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:13.557376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Getting quotas for project 75f93cd1b2a5494e933eedb3af0c283a. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:00:13.562707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Getting quotas for user c82999dd117a4335ae779cd92d45db4b and project 75f93cd1b2a5494e933eedb3af0c283a. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:00:13.595226 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:00:13.597730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:00:13.642220 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:13.657016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-55ba2a1a-25c2-43a5-8992-5d580a130320 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.267661 Jun 03 12:00:13.668288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:13 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:13.679344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-427fe862-5ed0-4d03-b638-ef143972a12c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506036 Jun 03 12:00:13.680568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 123/247] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:00:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:00:13.697618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-89fec866-6285-4d44-ab69-7e013818d9fe tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:13.698730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-89fec866-6285-4d44-ab69-7e013818d9fe tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:13.822382 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-89fec866-6285-4d44-ab69-7e013818d9fe tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:13.831104 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-89fec866-6285-4d44-ab69-7e013818d9fe tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1214 microversion: 2.1 time: 0.144672 Jun 03 12:00:13.841407 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 125/248] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:13 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:14.677945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:14.680162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:14.692332 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:14.693658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:14.695683 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:14.708690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:14.853419 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:14.854990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:14.867310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:14.868368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:14.870536 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:14.871366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:14.922130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:14.935920 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0b8c58dd-7950-48b2-978f-497a02a26c96 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.263263 Jun 03 12:00:14.936966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 124/249] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:14 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:14.996234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:15.005866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fb56b94f-0e3b-439d-81a3-1858aa424c0c tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1266 microversion: 2.1 time: 0.160734 Jun 03 12:00:15.016907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 126/250] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:14 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:15.953900 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:15.954624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:15.980111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:15.982643 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:15.983552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:15.987547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:16.026041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:16.026646 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:16.046408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:16.047069 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:16.049063 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:16.049689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:16.202069 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:16.210948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a338bb44-9517-47bf-9f03-52927f8ecbf9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1272 microversion: 2.1 time: 0.189510 Jun 03 12:00:16.222365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 127/251] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:16 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:16.357843 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:16.371111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fd2d52ae-271c-45c1-895f-d6430ab28f13 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.421106 Jun 03 12:00:16.377990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 125/252] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:15 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:17.227596 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:17.228210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:17.243573 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:17.244392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:17.245393 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:17.246024 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:17.394031 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:17.395535 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:17.415044 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:17.419284 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:17.420322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:17.420762 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:17.499709 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:17.509358 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ee72c2ba-7082-43d3-82fe-359f95ea57fa tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.285836 Jun 03 12:00:17.511160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 128/253] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:17 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:17.890798 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:17.913416 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7dbbbe0e-5c16-4f7e-854f-f80670ec283a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.522239 Jun 03 12:00:17.914597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 126/254] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:17 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:18.529999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:18.530977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:18.554785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:18.555256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:18.556019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:18.558275 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:18.848223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:18.868189 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3a74c710-fbde-400f-971d-ba76556d82c7 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.342678 Jun 03 12:00:18.869420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 129/255] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:18 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:18.930634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:18.932830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-6d17ac3c-b657-4225-ac86-7bd25292e5f1 req-49710d32-0e65-4879-91f1-120500a191d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21e1e1b-5426-4b87-88eb-88ece119ae28", "tag": "8d32abb7-7e14-4195-af1e-2f30c543c978"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:18.934258 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:18.952019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:18.968914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:18.971248 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-6d17ac3c-b657-4225-ac86-7bd25292e5f1 req-49710d32-0e65-4879-91f1-120500a191d3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:18.973804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:18.974460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:18.977360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-6d17ac3c-b657-4225-ac86-7bd25292e5f1 req-49710d32-0e65-4879-91f1-120500a191d3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:19.026219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-6d17ac3c-b657-4225-ac86-7bd25292e5f1 req-49710d32-0e65-4879-91f1-120500a191d3 service nova] Creating event network-changed:8d32abb7-7e14-4195-af1e-2f30c543c978 for instance f21e1e1b-5426-4b87-88eb-88ece119ae28 on hv-cinder-84457 Jun 03 12:00:19.043575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-6d17ac3c-b657-4225-ac86-7bd25292e5f1 req-49710d32-0e65-4879-91f1-120500a191d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120575 Jun 03 12:00:19.046235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 127/256] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:19.331783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:19.340736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bf46bfaf-88d3-437a-b4a8-f71138c89fd7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.414408 Jun 03 12:00:19.352333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 130/257] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:18 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:19.889759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:19.891588 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:19.902567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:19.903309 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:19.905434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:19.905931 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:20.211687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:20.223040 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ff3ab0ea-ab97-4145-b60d-af703e1d4689 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.341542 Jun 03 12:00:20.225309 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 128/258] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:19 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:20.358212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:20.359404 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:20.366040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:20.366760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:20.367615 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:20.368265 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:20.647839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:20.659473 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cdaa974f-520c-4120-9c71-59b467b63f18 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.304976 Jun 03 12:00:20.660625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 131/259] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:20 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:21.241478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:21.242104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:21.252227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:21.252631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:21.253416 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:21.258496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:21.560914 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:21.569419 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e1f07deb-20e8-4726-b970-91ef662dfbd4 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.332310 Jun 03 12:00:21.570056 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 129/260] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:21 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:21.677292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:21.677895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:21.687732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:21.692607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:21.694752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:21.695435 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:21.884056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:21.892672 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e2d584bb-a4f5-4183-bc87-60fc2a13b8df tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.218268 Jun 03 12:00:21.893669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 132/261] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:21 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:22.589632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:22.590748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:22.617261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:22.618137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:22.619122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:22.621591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:22.910247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:22.910907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:22.918824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:22.920497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:22.925123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:22.925795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:23.054607 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:23.070941 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b6db8415-9475-45fb-a995-b392844960ae tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.483689 Jun 03 12:00:23.075549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 130/262] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:22 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:23.255176 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:23.268095 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e70b538b-3af5-46ce-95c9-23ed253f0dcf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.361614 Jun 03 12:00:23.268634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 133/263] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:22 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:24.091076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:24.091824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:24.099289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:24.101322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:24.121092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:24.121562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:24.123727 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:24.125523 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:24.285424 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:24.285935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:24.300525 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:24.302690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:24.303144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:24.304497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:24.304935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:24.734018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:24.743335 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5c54d60d-2c65-41e5-83ec-871de17c8c00 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.658931 Jun 03 12:00:24.749633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:24 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:24.925431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:24.938864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-67a94b9b-569b-4376-b4f7-2f0e8c451830 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.657245 Jun 03 12:00:24.939971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 134/265] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:24 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:25.765867 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:25.766531 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:25.773454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:25.773884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:25.774651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:25.775083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:25.969377 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:25.978037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-676abc1d-81bd-41f7-acab-6e3e4ba8dfb2 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.216279 Jun 03 12:00:25.979556 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 135/266] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:25 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:25.985602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:25.986970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:25.994948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:25.995797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:25.996803 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:25.997497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:26.073938 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6c0dc72c-ba14-4ec7-ad0d-b109c54fa2b1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Action: 'create', calling method: .version_select at 0x7f19c63e9700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1974840395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcOjIVkHeWMQLooxTVZPy+bLVZyjawTIHBlcKMm6IhELE6WmPni8lSFQc1+mB9COIhrMa7ReujdSEOJH0AW8OQ5VFT8/uiS65UZDRvAGQrFbeys2981P1rTsvFS3vz7Gw=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:26.098208 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-6c0dc72c-ba14-4ec7-ad0d-b109c54fa2b1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Getting quotas for project a7c800014a3349c5aeac57178984e4c8. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:00:26.103514 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-6c0dc72c-ba14-4ec7-ad0d-b109c54fa2b1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Getting quotas for user 7d2bcfc5842e4faaa5369a19fce82d26 and project a7c800014a3349c5aeac57178984e4c8. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:00:26.153486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6c0dc72c-ba14-4ec7-ad0d-b109c54fa2b1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.391788 Jun 03 12:00:26.154169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 132/267] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:00:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:26.164300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:26.172398 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-011a5587-41eb-4d7b-8797-d4bca47f7ec8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.191016 Jun 03 12:00:26.173430 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 136/268] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:25 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:26.995491 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:26.996035 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:27.006876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:27.007656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:27.008636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:27.009765 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:27.189880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:27.191694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:27.203043 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:27.203478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:27.204278 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:27.204706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:27.258546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:27.274222 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-990b64ef-31d2-47e6-bd9e-484c3bfbf6ea tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.282716 Jun 03 12:00:27.275097 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 133/269] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:26 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:27.380486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:27.391385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bda51ebd-bf44-4d4f-a7b2-333c060f9784 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.205359 Jun 03 12:00:27.392548 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 137/270] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:27 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:28.291368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:28.292879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:28.301961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:28.302646 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:28.305616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:28.306644 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:28.408868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:28.409479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:28.419296 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:28.420116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:28.421029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:28.421650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:28.487452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:28.496233 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3b342dee-ec0d-4463-baf9-0cff10095199 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.209103 Jun 03 12:00:28.499825 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 134/271] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:28 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:28.613340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:28.617459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:28.626244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3c50ccde-8bf6-47f4-b154-006d0879c42f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.221027 Jun 03 12:00:28.627351 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 138/272] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:28 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:29.513780 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:29.515571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:29.522809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:29.532069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:29.532777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:29.533555 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:29.533990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:29.643465 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:29.645454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:29.653950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=64 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:29.657561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:29.658789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:29.660026 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:29.660749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:29.724234 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:29.738140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4cc885e3-e7ef-4920-b371-9e5a25764233 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.228145 Jun 03 12:00:29.739311 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 135/273] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:29 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:29.819651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:29.829083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3349dc89-a111-436a-8399-46e49c9c6165 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.189458 Jun 03 12:00:29.830159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 139/274] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:29 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:30.755243 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:30.756011 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:30.762785 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:30.763230 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:30.764185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:30.764616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:30.847281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:30.848171 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:30.855131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:30.855812 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:30.857037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:30.857607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:30.940394 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:30.944407 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-856c2d0f-13eb-4be9-a8a6-87308caad88f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.193365 Jun 03 12:00:30.945068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 136/275] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:30 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:31.002492 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:31.010232 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ffd3e4d7-9283-4888-9254-2c3f353101e4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.167225 Jun 03 12:00:31.010803 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 140/276] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:30 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:31.961176 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:31.961793 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:31.968345 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:31.968795 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:31.969553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:31.969988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:32.026316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:32.026922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:32.033640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:32.034096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:32.035135 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:32.035949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:32.099694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:32.107578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ef55cab8-e84a-4355-a9be-5d515d443d8d tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.150445 Jun 03 12:00:32.108498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 137/277] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:31 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:32.173228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:32.181281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6be369e9-3e7c-4275-9157-952a4d48d53a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.159045 Jun 03 12:00:32.181851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 141/278] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:32 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:33.125127 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:33.125738 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:33.132684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:33.133129 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:33.133880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:33.134317 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:33.197999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:33.199754 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:33.206203 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:33.206861 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:33.207831 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:33.208293 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:33.277495 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:33.287100 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-99f184bf-bf5e-4b2c-8d76-843279897a5b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.165758 Jun 03 12:00:33.294996 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 138/279] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:33 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:33.353012 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:33.360671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ec3bdf25-d194-4861-ab38-e24e3ee12e37 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.166419 Jun 03 12:00:33.361238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 142/280] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:33 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:34.304662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:34.305285 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:34.311816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:34.312269 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:34.313231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:34.313673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:34.376938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:34.377620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:34.384581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:34.385020 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:34.385761 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:34.386184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:34.450009 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:34.457520 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1ffab437-ab52-4f3d-b764-b2c089a4ba03 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.157201 Jun 03 12:00:34.458090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 139/281] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:34 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:34.521435 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:34.529003 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9682a54b-6d42-4ac8-9090-49fa5c3ef5e6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.155956 Jun 03 12:00:34.529550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 143/282] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:34 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:35.473909 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:35.474600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:35.481567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:35.482018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:35.483019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:35.483481 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:35.546017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:35.546684 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:35.552589 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:35.553591 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:35.554351 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:35.554778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:35.616080 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:35.623412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6f50f0b4-2e0c-490d-b4dd-127f4606ee5f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.153382 Jun 03 12:00:35.624003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 140/283] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:35 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:35.683908 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:35.691154 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c45274ae-9a85-4b4d-b578-51945e82818e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.148942 Jun 03 12:00:35.691739 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 144/284] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:35 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:00:36.641079 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:36.642385 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:36.645624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:36.651146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:36.651477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:36.652735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:36.653209 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:36.677084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:36.710616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:36.711364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:36.718607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:36.719269 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:36.720258 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:36.720847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:36.878384 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:36.888147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-60680c3e-6f53-45c6-90ac-aa9674ab1208 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.182371 Jun 03 12:00:36.888846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 145/285] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:36 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:36.976178 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:36.983777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-faa3998b-b29b-4589-9c71-0d4d58850663 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.346853 Jun 03 12:00:36.984352 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 141/286] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:36 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:37.908541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:37.909346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:37.919743 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:37.920901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:37.922687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:37.923471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:38.001988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:38.002865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:38.015973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:38.016709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:38.017647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:38.018239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:38.122887 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:38.130403 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9b0005da-b530-4270-b444-6df8264117c9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.228001 Jun 03 12:00:38.131550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 146/287] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:37 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:38.266986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:38.276067 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-563b2c5f-ca4d-46ce-a13f-e10b7dcb98d6 req-fa8f133e-697f-450c-923f-8ca5a8a83433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e1e1b-5426-4b87-88eb-88ece119ae28", "name": "network-vif-plugged", "status": "completed", "tag": "8d32abb7-7e14-4195-af1e-2f30c543c978"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:38.308651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-563b2c5f-ca4d-46ce-a13f-e10b7dcb98d6 req-fa8f133e-697f-450c-923f-8ca5a8a83433 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:38.309443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3ace0e24-79d8-4223-b109-fe2f7ab555c9 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.307209 Jun 03 12:00:38.324098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 142/288] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:37 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:38.324894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-563b2c5f-ca4d-46ce-a13f-e10b7dcb98d6 req-fa8f133e-697f-450c-923f-8ca5a8a83433 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:38.347159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-563b2c5f-ca4d-46ce-a13f-e10b7dcb98d6 req-fa8f133e-697f-450c-923f-8ca5a8a83433 service nova] Creating event network-vif-plugged:8d32abb7-7e14-4195-af1e-2f30c543c978 for instance f21e1e1b-5426-4b87-88eb-88ece119ae28 on hv-cinder-84457 Jun 03 12:00:38.354394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-563b2c5f-ca4d-46ce-a13f-e10b7dcb98d6 req-fa8f133e-697f-450c-923f-8ca5a8a83433 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103169 Jun 03 12:00:38.356146 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 147/289] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:39.149091 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:39.149861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:39.156650 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.157032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.157920 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.158490 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.296976 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:39.305357 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-88911b41-a13d-42dc-a0a9-b8cdbf71b75f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1501 microversion: 2.1 time: 0.161417 Jun 03 12:00:39.305919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 143/290] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:39 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:39.324232 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c089aee6-ad64-428c-a500-ee308545fe9a"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:39.325587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:39.326134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:39.327210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:39.331966 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.332513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.333358 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.333866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.334201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.334722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.335842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.336624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.359811 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] HTTP exception thrown: Cannot 'attach_volume' instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 while it is in vm_state rescued Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Request method failure captured: Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/os-volume_attachments HTTP/1.1 Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 74 Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfduedHNt1m7wblLZ9kOTIzLGXSMupGli3zb3RkbS-guY0WE5PnKCpv-w_uck9rKeOOuChQzR99EbSnYRFXFztFcVb3535efxUgctS-SzVU9VaBjG1MiQbh9c-zhMuUaCD-hv8WFiLT8tIego4vD4IoGmr9TgGeB3X-Ykx1ugCRw1Tc Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:00:39.361979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_799fb68a55084528ab5573051a1bf121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/799fb68a55084528ab5573051a1bf121"}]}] Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: abcc58cb66804297b184e41726c281bb Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {"volumeAttachment": {"volumeId": "c089aee6-ad64-428c-a500-ee308545fe9a"}} Jun 03 12:00:39.363271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Cannot 'attach_volume' instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 while it is in vm_state rescued Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'server_id': 'cb7dbfbf-015e-447d-96cd-5ab9efa88d62', 'body': {'volumeAttachment': {'volumeId': 'c089aee6-ad64-428c-a500-ee308545fe9a'}}} Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:39.364042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 while it is in vm_state rescued Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:39.365168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 while it is in vm_state rescued Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Returning 409 to user: Cannot 'attach_volume' instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 while it is in vm_state rescued {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-93c48c88-b0e0-4a49-9109-f7f9dc90853e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045599 Jun 03 12:00:39.366904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 148/291] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:00:39 2022] POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 12:00:39.376999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:39.377728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:39.385433 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.386144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.387087 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.387728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.479607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3be6d281-6058-4fa5-81e1-725328d313de tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/action" status: 202 len: 0 microversion: 2.1 time: 0.107022 Jun 03 12:00:39.481974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 149/292] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:00:39 2022] POST /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 12:00:39.498245 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:39.498955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:39.513351 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.513793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.514576 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:39.515025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:39.558951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:39.570368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c93b41c5-591c-47e9-ac2c-ffe18c85ac73 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.248071 Jun 03 12:00:39.576876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 144/293] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:39 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:39.736444 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:39.751762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d58a8ae7-cc56-48dd-a018-eb403940e886 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1509 microversion: 2.1 time: 0.257833 Jun 03 12:00:39.752606 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 150/294] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:39 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:40.586924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:40.587539 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:40.593889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:40.594329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:40.595081 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:40.595531 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:40.733267 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:40.742515 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3cda0a22-8fab-47eb-80a9-a1e95924f17b tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1314 microversion: 2.1 time: 0.160154 Jun 03 12:00:40.743283 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 145/295] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:40 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:40.770352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:40.771027 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:40.777652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:40.778098 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:40.778864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:40.779313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:40.952181 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:40.963278 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-adee9e19-3d17-469a-9dae-034516135a34 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1509 microversion: 2.1 time: 0.197472 Jun 03 12:00:40.974241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 151/296] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:40 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:41.759588 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:41.760804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:41.767625 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:41.768125 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:41.768886 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:41.769368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:41.925718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:41.935361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-90916e49-fbf4-402a-a292-1698f4e32a87 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1497 microversion: 2.1 time: 0.178117 Jun 03 12:00:41.939880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 146/297] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:41 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:41.987844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:41.989319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:42.005352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:42.007147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:42.008537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:42.009073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:42.181171 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:42.190757 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5be087e3-4688-43f1-8c7f-e6985eae1798 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1509 microversion: 2.1 time: 0.212142 Jun 03 12:00:42.193498 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 152/298] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:41 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:42.529384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:42.529802 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:42.535803 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:42.536438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:42.537199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:42.537674 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:42.562896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:00:42.653832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9bc57a76-f405-4f06-8029-06cfeb243160 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 204 len: 0 microversion: 2.1 time: 0.128109 Jun 03 12:00:42.654925 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 147/299] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:00:42 2022] DELETE /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:00:42.672879 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:42.673741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:42.683948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:42.684654 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:42.685663 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:42.686253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:42.851546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:42.862195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-609c6bd9-170d-4a77-ab86-57772af1fed3 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1503 microversion: 2.1 time: 0.203215 Jun 03 12:00:42.862966 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 153/300] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:42 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:43.211201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:43.211932 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:43.218969 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:43.219749 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:43.220810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:43.221323 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:43.366434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:43.373919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-10a2cd38-c55b-4edd-a154-0bab070a4d27 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1509 microversion: 2.1 time: 0.167489 Jun 03 12:00:43.374512 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 148/301] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:43 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:43.880166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:43.880790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:43.887323 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:43.888016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:43.888780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:43.889211 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:44.099406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:44.108045 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-de9f3848-dfda-4a42-925d-f9b5b2528a7f tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1503 microversion: 2.1 time: 0.231554 Jun 03 12:00:44.108741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 154/302] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:43 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:44.391090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:44.391726 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:44.398922 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:44.399376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:44.400180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:44.400621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:44.542271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:44.550259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8b1d2a9b-c3db-4464-97dd-c88a97ab8a24 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1509 microversion: 2.1 time: 0.163042 Jun 03 12:00:44.550927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 149/303] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:44 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:45.125563 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:45.126709 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:45.133378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:45.134030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:45.134788 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:45.135206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:45.154790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:45.289358 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:45.297199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-927ca1a3-5649-40da-9b59-5b9966129207 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1503 microversion: 2.1 time: 0.175539 Jun 03 12:00:45.297771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 155/304] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:45 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:45.570261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:45.571078 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:45.578542 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:45.579185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:45.580632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:45.581342 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:45.740436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:45.754719 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-99809e98-7385-4757-ad64-8e110d20e259 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1509 microversion: 2.1 time: 0.191127 Jun 03 12:00:45.755587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 150/305] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:45 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:46.314338 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:46.314971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:46.321111 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:46.321546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:46.322321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:46.322729 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:46.464083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:46.471433 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fed005b6-d47a-4f97-bee9-7960f8f4f570 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1503 microversion: 2.1 time: 0.160974 Jun 03 12:00:46.472025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 156/306] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:46 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:46.776371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:46.778848 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:46.789602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:46.790048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:46.790817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:46.791250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:47.064229 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:47.072318 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f72c2d15-ff3d-4be5-a758-355213c7b038 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1515 microversion: 2.1 time: 0.301286 Jun 03 12:00:47.072875 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 151/307] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:46 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:47.339629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-106689c7-d310-4dbb-a974-8798f1f2ec39 req-ae04c25e-ebb2-4951-a245-09c5909a42e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e1e1b-5426-4b87-88eb-88ece119ae28", "name": "network-vif-deleted", "tag": "8d32abb7-7e14-4195-af1e-2f30c543c978"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:47.357256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-106689c7-d310-4dbb-a974-8798f1f2ec39 req-ae04c25e-ebb2-4951-a245-09c5909a42e2 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:47.357808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-106689c7-d310-4dbb-a974-8798f1f2ec39 req-ae04c25e-ebb2-4951-a245-09c5909a42e2 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:47.375587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-106689c7-d310-4dbb-a974-8798f1f2ec39 req-ae04c25e-ebb2-4951-a245-09c5909a42e2 service nova] Creating event network-vif-deleted:8d32abb7-7e14-4195-af1e-2f30c543c978 for instance f21e1e1b-5426-4b87-88eb-88ece119ae28 on hv-cinder-84457 Jun 03 12:00:47.381983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-106689c7-d310-4dbb-a974-8798f1f2ec39 req-ae04c25e-ebb2-4951-a245-09c5909a42e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049609 Jun 03 12:00:47.383034 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 157/308] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:47.489107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:47.489766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:47.496933 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:47.497647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:47.498695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:47.499402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:47.533656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:47.534105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:47.534552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lazy-loading 'fault' on Instance uuid f21e1e1b-5426-4b87-88eb-88ece119ae28 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:00:47.575412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82999dd117a4335ae779cd92d45db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f93cd1b2a5494e933eedb3af0c283a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:47.583287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8fdd27da-05b4-4f69-bb41-58740e1ba378 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 200 len: 1304 microversion: 2.1 time: 0.098671 Jun 03 12:00:47.583950 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 152/309] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:47 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:48.602650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:48.603387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] [instance: f21e1e1b-5426-4b87-88eb-88ece119ae28] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:48.609614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:48.610054 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:48.610999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:48.611427 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:48.625297 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] HTTP exception thrown: Instance f21e1e1b-5426-4b87-88eb-88ece119ae28 could not be found. Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Request method failure captured: Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 HTTP/1.1 Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfeccR7Xn4K2RJmWu5Iy6KGNMrQM1ltcVVBtaCPovwPypvlbSiDz_OcHh_y2uVWyqL8Gg5l_sMFFAmzKr-lLGnFj93MmbW44NeHzUeZ6iXNDmoz7f0PlmRbaGGavapqYewYYeSh_LWZDm3oXBy1DfaJCVarDrk9UNlE0lD4FmmJA4HM Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 75f93cd1b2a5494e933eedb3af0c283a Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-VolumesActionsTest-35022083 Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:00:48.626890 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/75f93cd1b2a5494e933eedb3af0c283a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_75f93cd1b2a5494e933eedb3af0c283a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/75f93cd1b2a5494e933eedb3af0c283a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/75f93cd1b2a5494e933eedb3af0c283a"}]}] Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-VolumesActionsTest-35022083 Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 75f93cd1b2a5494e933eedb3af0c283a Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-VolumesActionsTest-35022083 Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-VolumesActionsTest-35022083-project Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: c82999dd117a4335ae779cd92d45db4b Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-VolumesActionsTest-35022083-project Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance f21e1e1b-5426-4b87-88eb-88ece119ae28 could not be found. Jun 03 12:00:48.628452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'f21e1e1b-5426-4b87-88eb-88ece119ae28'} Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21e1e1b-5426-4b87-88eb-88ece119ae28 could not be found. Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:00:48.629311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21e1e1b-5426-4b87-88eb-88ece119ae28 could not be found. Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21e1e1b-5426-4b87-88eb-88ece119ae28 could not be found. Jun 03 12:00:48.630728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:00:48.633703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] Returning 404 to user: Instance f21e1e1b-5426-4b87-88eb-88ece119ae28 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:00:48.633703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-083ad080-4331-4c62-82a6-8d4016f1cbe6 tempest-VolumesActionsTest-35022083 tempest-VolumesActionsTest-35022083-project] 10.222.0.15 "GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28" status: 404 len: 111 microversion: 2.1 time: 0.031098 Jun 03 12:00:48.633703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 158/310] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:48 2022] GET /compute/v2.1/servers/f21e1e1b-5426-4b87-88eb-88ece119ae28 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:00:49.521247 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-27cb5f4c-0e23-4897-937c-11a18b0be23f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'create', calling method: .version_select at 0x7f19c6416b80>, body: {"keypair": {"name": "tempest-keypair-636258561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb5SHMrh/nMZqo0luBrWiag34pieAepEQkKSjOi6utTtppzgZ0LybYoEyZ2tjhtbN0wAa4VNjY5onuEQHCy4hEKCWGNw/1ZjWmRMIqwJXR1OftnCvvYVAmTwfn4ZuYuyw=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:49.536897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-27cb5f4c-0e23-4897-937c-11a18b0be23f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for project 799fb68a55084528ab5573051a1bf121. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:00:49.541587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-27cb5f4c-0e23-4897-937c-11a18b0be23f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for user abcc58cb66804297b184e41726c281bb and project 799fb68a55084528ab5573051a1bf121. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:00:49.563340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-27cb5f4c-0e23-4897-937c-11a18b0be23f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045924 Jun 03 12:00:49.564085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 153/311] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:00:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:51.292656 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1483365997", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f261ea3b-fc07-4f2c-9a10-192bbbd56274"}], "security_groups": [{"name": "tempest-securitygroup--2146532651"}], "key_name": "tempest-keypair-636258561", "user_data": "}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:51.415143 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] validate_networks() for [('f261ea3b-fc07-4f2c-9a10-192bbbd56274', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:00:51.793326 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:00:51.793756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:00:51.794231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:00:51.794641 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:00:51.795052 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:00:51.804108 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:51.804551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:51.805341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:51.805774 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:51.823685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for project 799fb68a55084528ab5573051a1bf121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:00:51.827036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Getting quotas for user abcc58cb66804297b184e41726c281bb and project 799fb68a55084528ab5573051a1bf121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:00:51.838924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:00:51.841265 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:00:51.889526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-41ab0e17-dac4-425b-a3fc-08e244784398 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.603838 Jun 03 12:00:51.894149 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 159/312] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:00:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:00:51.902392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ddc5dab8-da85-4ff1-b66b-28ce0221c57a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:51.903649 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ddc5dab8-da85-4ff1-b66b-28ce0221c57a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:51.962609 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ddc5dab8-da85-4ff1-b66b-28ce0221c57a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:51.971386 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ddc5dab8-da85-4ff1-b66b-28ce0221c57a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1245 microversion: 2.1 time: 0.074739 Jun 03 12:00:51.972159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 154/313] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:51 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:52.988567 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:52.989173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:52.996490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:52.996935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:52.997686 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:52.998116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:53.056628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:53.064053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ab0b3ec4-a6b5-488f-a02a-5e1fa754db72 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1249 microversion: 2.1 time: 0.079170 Jun 03 12:00:53.064996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 160/314] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:52 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:54.081181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:54.081792 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:54.088371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:54.088822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:54.089577 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:54.090020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:54.149162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:54.156520 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9ef5828c-0bbf-459c-9925-3f8598fafbe9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1249 microversion: 2.1 time: 0.079160 Jun 03 12:00:54.157013 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 155/315] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:54 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:55.173717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:55.174249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:55.180837 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:55.181280 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:55.182025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:55.182450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:55.239789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:55.247450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6443ea61-3af6-48ee-84f7-21e95dc421ff tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1249 microversion: 2.1 time: 0.077617 Jun 03 12:00:55.248054 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 161/316] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:55 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:56.264867 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:56.265388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:56.272869 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:56.273338 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:56.274163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:56.274608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:56.333442 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:56.341299 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6cd7a655-c9a6-4e0f-80d9-acd2a9f3fb1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1249 microversion: 2.1 time: 0.080419 Jun 03 12:00:56.341849 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 156/317] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:56 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:57.357812 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:57.358585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:57.369149 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:57.369600 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:57.370365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:57.370797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:57.438944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:57.446686 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-205bd48b-bfd3-4089-8f74-a37a4b15350b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1305 microversion: 2.1 time: 0.092610 Jun 03 12:00:57.447441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 162/318] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:57 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:58.466922 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:58.467554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:58.475799 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:58.476445 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:58.477509 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:58.478212 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:58.675061 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:58.679472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:58.684813 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-70adbdba-e2a1-4330-83e7-8a9b4a3715fe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.223506 Jun 03 12:00:58.685728 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 157/319] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:58 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:00:59.117276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-13268d30-92db-4853-8df3-0cbd0d54ab5d req-c47959ac-374c-4f4c-8c12-0d67b8115d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187129e0-f035-4b58-b3ff-7a6bb94ed536", "tag": "edce147b-e88b-4b4e-9723-100efdf1322f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:00:59.133120 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-13268d30-92db-4853-8df3-0cbd0d54ab5d req-c47959ac-374c-4f4c-8c12-0d67b8115d1a service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:59.134696 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-13268d30-92db-4853-8df3-0cbd0d54ab5d req-c47959ac-374c-4f4c-8c12-0d67b8115d1a service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:59.163174 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-13268d30-92db-4853-8df3-0cbd0d54ab5d req-c47959ac-374c-4f4c-8c12-0d67b8115d1a service nova] Creating event network-changed:edce147b-e88b-4b4e-9723-100efdf1322f for instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 on hv-cinder-84457 Jun 03 12:00:59.175753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-13268d30-92db-4853-8df3-0cbd0d54ab5d req-c47959ac-374c-4f4c-8c12-0d67b8115d1a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063134 Jun 03 12:00:59.180104 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 163/320] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:00:59.702167 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:00:59.702790 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:00:59.706665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:59.716561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:59.717560 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:59.718339 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:00:59.718951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:00:59.881980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:00:59.891564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-180e97a9-dc97-4982-bfcc-9c14a16e69cb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.192894 Jun 03 12:00:59.892023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 158/321] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:00:59 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:00.909394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:00.910114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:00.912318 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:00.918341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:00.919042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:00.919871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:00.920297 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:01.092306 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:01.100737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-359d4d90-b4ba-45c4-9a91-b13db9e7ed2a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.195598 Jun 03 12:01:01.110212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 164/322] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:00 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:02.121909 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:02.138030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:02.141122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:02.148022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:02.148478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:02.149257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:02.149689 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:02.302661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:02.309956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-97b49580-a26b-49bd-954e-aeb76d20981b tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.195502 Jun 03 12:01:02.310509 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 159/323] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:02 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:02.941791 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-936786428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1974840395", "security_groups": [{"name": "tempest-secgroup-smoke-1145985512"}], "networks": [{"uuid": "4cd9aad5-3f2f-4aa5-b526-91fd587f68f6"}], "block_device_mapping_v2": [{"uuid": "8e016094-21d6-4d58-8266-f74d65904f00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:02.955140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:02.956583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:03.065798 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] validate_networks() for [('4cd9aad5-3f2f-4aa5-b526-91fd587f68f6', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:01:03.326496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:03.327321 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:03.334850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:03.335295 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:03.336289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:03.336884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:03.502793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:01:03.503612 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:01:03.504212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:01:03.504722 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:01:03.505238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:01:03.518324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:03.519245 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:03.523372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:03.524171 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:03.546158 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Getting quotas for project a7c800014a3349c5aeac57178984e4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:01:03.551489 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Getting quotas for user 7d2bcfc5842e4faaa5369a19fce82d26 and project a7c800014a3349c5aeac57178984e4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:01:03.607058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:03.617911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d4746ac8-9c53-456b-8d63-035c32807a43 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.295264 Jun 03 12:01:03.619109 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 160/324] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:03 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:03.628349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:01:03.632434 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e016094-21d6-4d58-8266-f74d65904f00',volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:01:03.800084 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-683e5b60-7e1f-4ce4-92dc-1a9ba1bc71b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862312 Jun 03 12:01:03.803541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 165/325] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:01:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:01:03.812884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f93de87b-5967-4aad-b915-fa0aa8ff4810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:03.820389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f93de87b-5967-4aad-b915-fa0aa8ff4810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:03.978379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f93de87b-5967-4aad-b915-fa0aa8ff4810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:03.988806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f93de87b-5967-4aad-b915-fa0aa8ff4810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1088 microversion: 2.1 time: 0.180186 Jun 03 12:01:04.000953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 161/326] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:03 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1088 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:04.636691 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:04.638152 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:04.646513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:04.647667 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:04.648841 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:04.649364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:04.802260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:04.812008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cea77538-15f8-488b-bc4a-c26bf79dba79 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.179839 Jun 03 12:01:04.813212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 166/327] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:04 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:05.008837 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:05.010525 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:05.022916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:05.024717 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:05.026331 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:05.027387 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:05.143842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:05.155769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-586a14cb-f6a5-4cf4-a6f1-c07380f914c2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1194 microversion: 2.1 time: 0.150766 Jun 03 12:01:05.156397 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 162/328] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:05 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:05.829606 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:05.830215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:05.836826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:05.837822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:05.839428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:05.840351 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:06.127647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:06.136719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-99405979-e6be-4855-8b4a-99e085e4e7fd tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.310854 Jun 03 12:01:06.151990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 167/329] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:05 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:06.173490 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:06.174734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:06.182894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:06.183797 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:06.184815 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:06.185480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:06.468989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:06.479052 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-30ab9fd0-cad2-4a36-8b07-fc9e4c0dbe87 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.309994 Jun 03 12:01:06.480205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 163/330] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:06 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:06.919587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-7497803e-f41b-40c1-864a-e93af34c437d req-b1ab966a-f9bf-4ec1-8c3e-be23b061ce18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187129e0-f035-4b58-b3ff-7a6bb94ed536", "name": "network-vif-plugged", "status": "completed", "tag": "edce147b-e88b-4b4e-9723-100efdf1322f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:06.939325 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-7497803e-f41b-40c1-864a-e93af34c437d req-b1ab966a-f9bf-4ec1-8c3e-be23b061ce18 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:06.939813 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-7497803e-f41b-40c1-864a-e93af34c437d req-b1ab966a-f9bf-4ec1-8c3e-be23b061ce18 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:06.970157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-7497803e-f41b-40c1-864a-e93af34c437d req-b1ab966a-f9bf-4ec1-8c3e-be23b061ce18 service nova] Creating event network-vif-plugged:edce147b-e88b-4b4e-9723-100efdf1322f for instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 on hv-cinder-84457 Jun 03 12:01:06.979467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-7497803e-f41b-40c1-864a-e93af34c437d req-b1ab966a-f9bf-4ec1-8c3e-be23b061ce18 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063995 Jun 03 12:01:06.980715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 168/331] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:07.159276 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:07.160680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:07.179464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:07.181340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:07.182414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:07.183425 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:07.497992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:07.499149 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:07.509148 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:07.510050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:07.511253 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:07.511922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:07.557969 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:07.576835 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-85a7acc4-b160-4364-8bc7-a5c906c7b451 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.421855 Jun 03 12:01:07.581456 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 164/332] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:07 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:07.588610 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-8c8ef995-016d-4f41-8389-421febeba442 req-40e520b9-9e1f-4897-a5a0-1a872d6973b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:07.615835 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-8c8ef995-016d-4f41-8389-421febeba442 req-40e520b9-9e1f-4897-a5a0-1a872d6973b3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:07.621442 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-8c8ef995-016d-4f41-8389-421febeba442 req-40e520b9-9e1f-4897-a5a0-1a872d6973b3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:07.637573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-8c8ef995-016d-4f41-8389-421febeba442 req-40e520b9-9e1f-4897-a5a0-1a872d6973b3 service nova] Creating event network-changed:433e2f7b-47d6-4109-8c8b-a4880b50eadb for instance df0736cf-da48-4947-8e88-687dd441a9c2 on hv-cinder-84457 Jun 03 12:01:07.646416 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-8c8ef995-016d-4f41-8389-421febeba442 req-40e520b9-9e1f-4897-a5a0-1a872d6973b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063467 Jun 03 12:01:07.648006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 165/333] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:07.717142 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:07.726757 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c7bd786d-0692-4822-a230-67736e64ba48 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.232973 Jun 03 12:01:07.727930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 169/334] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:07 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:08.594346 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:08.595057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:08.602294 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:08.603023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:08.603830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:08.604884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:08.744906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:08.746196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:08.752685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:08.753441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:08.754473 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:08.754997 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:08.771080 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:08.783551 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-076c9365-4207-402c-8515-745fbe3101c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.193405 Jun 03 12:01:08.784159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 166/335] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:08 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:08.923659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:08.933037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7a1f1e98-a5e9-43b5-ac63-54e207821786 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.192083 Jun 03 12:01:08.934448 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 170/336] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:08 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:09.806103 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:09.807314 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:09.821389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:09.825591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:09.826630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:09.827068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:09.949937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:09.951420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:09.958561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:09.959644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:09.960673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:09.961435 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:10.110489 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:10.121465 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6edf2d99-5e38-4c62-a064-9d10393f4d25 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.173408 Jun 03 12:01:10.123082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 171/337] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:09 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:10.169486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:10.179287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-05b23c69-3c38-4a8d-9824-c901e01cffce tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1371 microversion: 2.1 time: 0.382459 Jun 03 12:01:10.189206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 167/338] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:09 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:11.138366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:11.138969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:11.145454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:11.145944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:11.147637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:11.148088 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:11.197947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:11.199546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:11.209699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:11.210759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:11.211840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:11.212547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:11.314938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:11.325736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1c367227-8eea-426a-866d-854cfcdd0dd4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.191155 Jun 03 12:01:11.326318 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 172/339] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:11 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:11.381383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:11.392416 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-94025dd6-fafb-4145-af04-4e8ce3adb293 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1564 microversion: 2.1 time: 0.198479 Jun 03 12:01:11.393078 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 168/340] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:11 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1564 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:11.416952 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:11.417687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:11.424375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:11.424905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:11.425747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:11.426247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:11.530889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-60a774a3-7305-437f-baf7-ca605cc116d5 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123813 Jun 03 12:01:11.533808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 173/341] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:01:11 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:12.343164 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:12.343813 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:12.355400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:12.355985 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:12.356777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:12.357231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:12.677947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:12.685515 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0d75852e-3197-4f47-ab86-52a8411d8ab7 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.346151 Jun 03 12:01:12.686871 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 169/342] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:12 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:13.021747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-e8844b9b-e83e-47a7-91fc-eaf34eb5a40d req-4b13e436-f7ab-46d9-8408-cba4576153f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187129e0-f035-4b58-b3ff-7a6bb94ed536", "tag": "edce147b-e88b-4b4e-9723-100efdf1322f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:13.031634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-e8844b9b-e83e-47a7-91fc-eaf34eb5a40d req-4b13e436-f7ab-46d9-8408-cba4576153f3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:13.032077 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-e8844b9b-e83e-47a7-91fc-eaf34eb5a40d req-4b13e436-f7ab-46d9-8408-cba4576153f3 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:13.046810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-e8844b9b-e83e-47a7-91fc-eaf34eb5a40d req-4b13e436-f7ab-46d9-8408-cba4576153f3 service nova] Creating event network-changed:edce147b-e88b-4b4e-9723-100efdf1322f for instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 on hv-cinder-84457 Jun 03 12:01:13.054187 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-e8844b9b-e83e-47a7-91fc-eaf34eb5a40d req-4b13e436-f7ab-46d9-8408-cba4576153f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036395 Jun 03 12:01:13.054836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 174/343] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:01:13.705240 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:13.707182 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:13.724929 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:13.725897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:13.726895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:13.729140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:13.941944 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:13.949776 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-05f83de8-d6ed-403b-be36-72e39462faeb tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.249020 Jun 03 12:01:13.950851 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 170/344] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:13 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:14.963562 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:14.965029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:14.969758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:14.970798 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:14.978949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:14.979652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:14.980358 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:14.981030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:15.124513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:15.132706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-893fd2f1-5af0-4e27-b973-bb6cc75a798e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.170082 Jun 03 12:01:15.133560 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 175/345] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:14 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:16.149993 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:16.150578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:16.152526 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:16.158392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:16.158840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:16.159630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:16.160067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:16.310889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:16.320653 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fde69d7b-97d7-4e84-a6f0-0f61a7300246 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.174810 Jun 03 12:01:16.321660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 171/346] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:16 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:17.341587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:17.342388 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:17.350832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:17.351379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:17.352382 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:17.353033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:17.360963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=93 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:17.511769 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:17.520327 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-30916ab3-73f1-4dcf-82fa-02f4cf1f7aa8 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.186262 Jun 03 12:01:17.522217 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 176/347] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:17 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:18.538067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:18.538764 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:18.545998 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:18.547986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:18.547986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:18.547986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:18.711114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:18.720230 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c3cfd084-7bc5-479a-805a-0dc1e09e8322 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.185984 Jun 03 12:01:18.721028 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 172/348] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:18 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:19.737251 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:19.737861 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:19.744337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:19.744787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:19.745541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:19.745975 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:19.871974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:19.879294 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-afdce0bd-a7d7-47c1-baef-8ee5d92a6e15 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.145791 Jun 03 12:01:19.879884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 177/349] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:19 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:20.896450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:20.897330 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:20.907845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:20.908296 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:20.909483 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:20.909483 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:21.055004 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:21.062631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2a0aa0e2-9b11-4eea-8bad-5e457f32f98b tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.169897 Jun 03 12:01:21.063220 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 173/350] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:20 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:22.079133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:22.079764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:22.085766 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:22.086206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:22.086949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:22.087376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:22.214649 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:22.222097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4ee6061e-e968-48ec-b4b6-3a7d6387b921 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.146814 Jun 03 12:01:22.222865 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 178/351] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:22 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:23.240981 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:23.242791 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:23.253046 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:23.253597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:23.254568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:23.255244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:23.392106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-be025129-b527-4cb8-9f1b-adf69bc89113 req-635e0437-0abf-403e-9cbb-1c2e4a235f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "name": "network-vif-plugged", "status": "completed", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:23.412816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-be025129-b527-4cb8-9f1b-adf69bc89113 req-635e0437-0abf-403e-9cbb-1c2e4a235f3b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:23.412816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-be025129-b527-4cb8-9f1b-adf69bc89113 req-635e0437-0abf-403e-9cbb-1c2e4a235f3b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:23.438268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:23.446269 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5fdba4ab-6169-44d9-b8d8-bd45a28d2b84 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.211581 Jun 03 12:01:23.446881 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 174/352] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:23 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:23.449784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-be025129-b527-4cb8-9f1b-adf69bc89113 req-635e0437-0abf-403e-9cbb-1c2e4a235f3b service nova] Creating event network-vif-plugged:433e2f7b-47d6-4109-8c8b-a4880b50eadb for instance df0736cf-da48-4947-8e88-687dd441a9c2 on hv-cinder-84457 Jun 03 12:01:23.456390 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-be025129-b527-4cb8-9f1b-adf69bc89113 req-635e0437-0abf-403e-9cbb-1c2e4a235f3b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069584 Jun 03 12:01:23.457128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 179/353] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:24.462137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:24.462744 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:24.469301 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:24.469751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:24.470505 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:24.470939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:24.599174 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:24.606505 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-52fdbc95-485a-4504-b19a-e297ed8e75ec tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.148226 Jun 03 12:01:24.607043 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 175/354] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:24 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:25.624332 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:25.625223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:25.631713 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:25.632165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:25.632918 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:25.633350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:25.767852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:25.776217 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9efb0dc1-1608-40ad-b0db-f39903dc4d3f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1260 microversion: 2.1 time: 0.156308 Jun 03 12:01:25.776758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 180/355] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:25 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:26.519015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1165464711", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:26.570740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] validate_networks() for None {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:01:26.793183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:26.795004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:26.804397 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:26.804836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:26.805644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:26.806293 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:26.857327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:01:26.857815 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:01:26.858372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:01:26.858829 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:01:26.859305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:01:26.868280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:26.868720 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:26.869504 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:26.869933 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:26.877451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:26.889366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Getting quotas for project 8a84f7c6c96c4a43bf6f2f4a59725156. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:01:26.893237 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Getting quotas for user 89f94b41bbc442d3bc065a0487de7259 and project 8a84f7c6c96c4a43bf6f2f4a59725156. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:01:26.911239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:01:26.913712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:01:26.943552 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:26.951640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c5ac7126-1714-4cd8-b3f1-94f22a5a3810 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1444 microversion: 2.1 time: 0.162285 Jun 03 12:01:26.952200 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 181/356] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:26 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:26.965908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7967e740-9c49-4080-975b-ec0bfdf6c188 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451214 Jun 03 12:01:26.966686 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 176/357] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:01:26.969742 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:26.970457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:26.976187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2d362d15-2b0f-4513-b776-1933b1d62ada tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:26.976707 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:26.976821 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2d362d15-2b0f-4513-b776-1933b1d62ada tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:26.977148 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:26.977901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:26.978332 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:27.033020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2d362d15-2b0f-4513-b776-1933b1d62ada tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:27.040889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2d362d15-2b0f-4513-b776-1933b1d62ada tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1215 microversion: 2.1 time: 0.068497 Jun 03 12:01:27.042265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 177/358] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:26 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:27.119381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:27.127019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a05af195-1e9c-49d8-8c88-1f625b1ba3c1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1444 microversion: 2.1 time: 0.162426 Jun 03 12:01:27.127610 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 182/359] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:26 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:28.058273 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:28.058836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:28.065480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:28.065926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:28.066684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:28.067117 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:28.335257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:28.342822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8b30fd26-c5b6-4c82-8f51-92f19d745115 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1267 microversion: 2.1 time: 0.288483 Jun 03 12:01:28.343391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 178/360] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:28 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:29.120706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-76d0bd56-09f7-4621-bb93-7807251862a9 req-a1014c1a-7415-4660-a1d6-50471377ed1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:29.128485 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-76d0bd56-09f7-4621-bb93-7807251862a9 req-a1014c1a-7415-4660-a1d6-50471377ed1f service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:29.128922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-76d0bd56-09f7-4621-bb93-7807251862a9 req-a1014c1a-7415-4660-a1d6-50471377ed1f service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:29.140164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-76d0bd56-09f7-4621-bb93-7807251862a9 req-a1014c1a-7415-4660-a1d6-50471377ed1f service nova] Creating event network-changed:433e2f7b-47d6-4109-8c8b-a4880b50eadb for instance df0736cf-da48-4947-8e88-687dd441a9c2 on hv-cinder-84457 Jun 03 12:01:29.144886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-76d0bd56-09f7-4621-bb93-7807251862a9 req-a1014c1a-7415-4660-a1d6-50471377ed1f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027783 Jun 03 12:01:29.146042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 183/361] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:29.360264 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:29.360867 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:29.367326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:29.367812 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:29.368568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:29.369005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:29.433328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:29.440697 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-09dc2c2f-6bac-4a84-90d1-539bd39c9fbd tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1267 microversion: 2.1 time: 0.084260 Jun 03 12:01:29.441196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 179/362] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:29 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:30.458781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:30.459524 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:30.465630 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:30.466072 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:30.466816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:30.467245 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:30.528225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:30.535518 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-dbe81b59-8195-4a3e-834a-6b35bd750e9f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1267 microversion: 2.1 time: 0.081443 Jun 03 12:01:30.536666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 184/363] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:30 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:31.552861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:31.553575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:31.556080 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:31.561956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:31.562404 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:31.563169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:31.563627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:31.668882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:31.677425 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-824fdd71-1e34-49a7-8985-5b2f61298f7b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1275 microversion: 2.1 time: 0.128665 Jun 03 12:01:31.678759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 180/364] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:31 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:32.694808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:32.695413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:32.697477 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:32.702630 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:32.703071 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:32.703850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:32.704279 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:32.846377 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:32.855417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b1e9083e-e6b1-460d-8f2e-c9cfef05dfdc tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.165025 Jun 03 12:01:32.857046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 185/365] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:32 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:33.547682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-d419a914-f0cc-4762-8990-e5187d883931 req-7cee2233-f3b4-4130-8a1f-569bc0b3db8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63abc6d6-c330-44ba-8543-39c01ea0ea2d", "tag": "cccf25dc-9d0e-48a9-907f-37eaa21194a7"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:33.562129 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d419a914-f0cc-4762-8990-e5187d883931 req-7cee2233-f3b4-4130-8a1f-569bc0b3db8b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:33.562810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d419a914-f0cc-4762-8990-e5187d883931 req-7cee2233-f3b4-4130-8a1f-569bc0b3db8b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:33.575629 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-d419a914-f0cc-4762-8990-e5187d883931 req-7cee2233-f3b4-4130-8a1f-569bc0b3db8b service nova] Creating event network-changed:cccf25dc-9d0e-48a9-907f-37eaa21194a7 for instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d on hv-cinder-84457 Jun 03 12:01:33.582824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-d419a914-f0cc-4762-8990-e5187d883931 req-7cee2233-f3b4-4130-8a1f-569bc0b3db8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047305 Jun 03 12:01:33.583827 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 181/366] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:33.874213 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:33.874958 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:33.881027 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:33.881463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:33.882215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:33.882634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:34.013907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:34.023719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7a796d98-820a-4931-b5f9-687e4266dfca tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.153245 Jun 03 12:01:34.024288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 186/367] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:33 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:35.041640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:35.042332 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:35.048514 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:35.048961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:35.049711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:35.050149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:35.179860 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:35.187218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-80f891e8-1a9f-4e2f-ab8c-5445c7d6816e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.150268 Jun 03 12:01:35.187806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 182/368] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:35 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:36.203755 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:36.204462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:36.212235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:36.212673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:36.213557 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:36.214047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:36.347323 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:36.357292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-37312727-3d3b-4b1d-87a8-68a5570fcdb4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.156705 Jun 03 12:01:36.358443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 187/369] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:36 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:37.377367 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:37.377974 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:37.380444 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:37.381123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=8 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:37.387759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:37.388210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:37.388968 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:37.389512 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:37.464106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:37.464671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:37.471019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:37.471871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:37.472847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:37.474041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:37.502938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6c96e27b-2ea0-4787-8fb7-ff9b03a7001d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/ips" status: 200 len: 153 microversion: 2.20 time: 0.042818 Jun 03 12:01:37.503555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 188/370] 10.222.0.15 () {60 vars in 1288 bytes} [Fri Jun 3 12:01:37 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:01:37.537774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:37.547474 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-db4056bf-38c6-4471-bb76-37a0539a9419 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.173818 Jun 03 12:01:37.549224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 183/371] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:37 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:38.565737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:38.566428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:38.572981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:38.573424 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:38.574178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:38.574605 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:38.740443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:38.749207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-913e1b91-2054-46aa-8b1c-a82e918d3c2a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.187205 Jun 03 12:01:38.749950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 189/372] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:38 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:39.766543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:39.767158 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:39.774934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:39.775378 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:39.776157 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:39.776587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:39.903479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:39.910639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-434f6523-f2ea-4d6b-a238-71ad1efd7ffb tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.147923 Jun 03 12:01:39.911204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 184/373] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:39 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:40.927844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:40.928469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:40.934503 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:40.934946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:40.935729 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:40.936159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:41.061259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:41.069195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4aa247db-17b4-4621-acb4-f0f4f4bf28f4 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.145718 Jun 03 12:01:41.069732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 190/374] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:40 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:42.086020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:42.086626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:42.093131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:42.093573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:42.094328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:42.094755 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:42.223884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:42.231176 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-323769ca-4df1-4352-af15-f3b2735cf5f0 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.149591 Jun 03 12:01:42.231866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 185/375] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:42 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:43.248649 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:43.249250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:43.255873 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:43.256316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:43.257067 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:43.257523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:43.381335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:43.388603 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-06777d66-5566-49f0-92e8-d3f894a9603e tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.143744 Jun 03 12:01:43.389160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 191/376] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:43 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:44.059072 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:44.059600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:44.065936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:44.066376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:44.067752 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:44.068181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:44.089488 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lazy-loading 'flavor' on Instance uuid a5e00459-a0d4-4520-bc60-02901fe74ffe {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:01:44.343049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cef46298-d697-4235-b428-eb8233a52a65 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/action" status: 202 len: 0 microversion: 2.20 time: 0.287710 Jun 03 12:01:44.343702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 186/377] 10.222.0.15 () {62 vars in 1318 bytes} [Fri Jun 3 12:01:44 2022] POST /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:01:44.354317 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:44.354924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:44.360987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:44.361331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:44.362098 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:44.362512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:44.406013 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:44.406831 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:44.413956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:44.414403 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:44.415165 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:44.415822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:44.497638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:44.506031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:44.507551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:44.508701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3124db3e-370e-4a25-80bb-d2e86eeec046 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.158581 Jun 03 12:01:44.509260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 192/378] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:44 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:44.545903 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:44.553281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-eaec9416-f974-4cee-9abc-1cbfaeb81122 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.151473 Jun 03 12:01:44.553833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 187/379] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:44 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:45.528335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:45.528894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:45.534840 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:45.535285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:45.536078 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:45.536510 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:45.570297 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:45.571030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:45.577806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:45.578252 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:45.579016 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:45.579447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:45.668480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:45.677421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:45.678940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:45.680400 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f7566c6c-cffc-4c18-bc01-41e7561f8d84 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.156057 Jun 03 12:01:45.692367 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 193/380] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:45 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:45.724079 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:45.731734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6b81f594-412c-4d24-ae97-f9beaea189b1 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.165893 Jun 03 12:01:45.732619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 188/381] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:45 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:45.847374 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-3cc1ab57-cb0a-43c3-8cfe-05f31494318a req-2b9e5908-24d4-45ea-9a98-0c8d473b5ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63abc6d6-c330-44ba-8543-39c01ea0ea2d", "name": "network-vif-plugged", "status": "completed", "tag": "cccf25dc-9d0e-48a9-907f-37eaa21194a7"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:45.855970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-3cc1ab57-cb0a-43c3-8cfe-05f31494318a req-2b9e5908-24d4-45ea-9a98-0c8d473b5ed0 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:45.856441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-3cc1ab57-cb0a-43c3-8cfe-05f31494318a req-2b9e5908-24d4-45ea-9a98-0c8d473b5ed0 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:45.868145 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-3cc1ab57-cb0a-43c3-8cfe-05f31494318a req-2b9e5908-24d4-45ea-9a98-0c8d473b5ed0 service nova] Creating event network-vif-plugged:cccf25dc-9d0e-48a9-907f-37eaa21194a7 for instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d on hv-cinder-84457 Jun 03 12:01:45.872940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-3cc1ab57-cb0a-43c3-8cfe-05f31494318a req-2b9e5908-24d4-45ea-9a98-0c8d473b5ed0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029215 Jun 03 12:01:45.873519 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 194/382] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:46.699626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:46.700153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:46.706478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:46.706919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:46.708324 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:46.708757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:46.750917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:46.751652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:46.758505 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:46.758968 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:46.759863 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:46.760506 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:46.764007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=100 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:46.843585 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:46.851537 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:46.853029 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:46.854207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-55ca3dad-470d-45b3-b1a4-c60b6b4b3e12 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.158571 Jun 03 12:01:46.854761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 189/383] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:46 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:01:46.899552 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:46.907047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-31ec4ef1-12fc-467a-b543-69deff3bc06f tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1315 microversion: 2.1 time: 0.160681 Jun 03 12:01:46.907647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 195/384] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:46 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:47.872564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:47.873204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:47.879728 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:47.880688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:47.881436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:47.881868 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:47.923558 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:47.924165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:47.930098 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:47.930535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:47.931291 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:47.931744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:48.014701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:48.024385 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:48.025899 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:48.027065 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-957b1da5-8a15-4b88-970d-90746f07898a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.158486 Jun 03 12:01:48.027662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 190/385] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:47 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:48.060112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:48.068070 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d7835732-4909-491f-b1c8-504b4d3ff587 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1463 microversion: 2.1 time: 0.147837 Jun 03 12:01:48.068628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 196/386] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:47 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:01:48.106640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:48.107139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:48.113140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:48.113593 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:48.114412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:48.114851 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:48.139340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:01:48.184860 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:48.214527 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a9551592-cc13-423b-bcd7-70d60deacc81 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 204 len: 0 microversion: 2.1 time: 0.111506 Jun 03 12:01:48.215226 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 191/387] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:01:48 2022] DELETE /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:01:48.222949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:48.223579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:48.229428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:48.229880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:48.230634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:48.231126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:48.363240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:48.376541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9e775db2-a45a-45ec-81c9-3eea5046e35b tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1469 microversion: 2.1 time: 0.152034 Jun 03 12:01:48.376541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 197/388] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:48 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:49.045761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:49.046451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:49.052830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:49.053271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:49.054019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:49.054449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:49.183218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:49.190975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:49.192479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:49.193621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8deced77-d1ff-4c99-b53c-8865851489fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.152250 Jun 03 12:01:49.194175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 192/389] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:49 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:49.388319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:49.388924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:49.394949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:49.395392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:49.396731 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:49.397408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:49.522284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:49.529629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b7ff8111-39c3-4fa3-8509-0d5a6600628a tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1469 microversion: 2.1 time: 0.145170 Jun 03 12:01:49.530174 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 198/390] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:49 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1469 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:50.211620 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:50.212277 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:50.218874 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:50.219416 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:50.220272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:50.220777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:50.394972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:50.411312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:50.413225 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:50.414682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9ba2e9de-ec7e-436c-9326-024efb5398f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.207801 Jun 03 12:01:50.415312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 193/391] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:50 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:50.546678 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:50.548129 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:50.555199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:50.555690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:50.556697 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:50.557123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:50.705905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f94b41bbc442d3bc065a0487de7259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a84f7c6c96c4a43bf6f2f4a59725156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:50.715620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-da74428a-6ce3-4525-a608-20406b3633b2 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 200 len: 1469 microversion: 2.1 time: 0.172229 Jun 03 12:01:50.725216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 199/392] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:50 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:01:50.842143 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-9e2d28cd-3af6-4181-a075-0a5ae4104986 req-5ffbd4b1-082b-44f9-9883-d71a6050edfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63abc6d6-c330-44ba-8543-39c01ea0ea2d", "name": "network-vif-deleted", "tag": "cccf25dc-9d0e-48a9-907f-37eaa21194a7"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:01:50.851219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-9e2d28cd-3af6-4181-a075-0a5ae4104986 req-5ffbd4b1-082b-44f9-9883-d71a6050edfb service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:50.851691 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-9e2d28cd-3af6-4181-a075-0a5ae4104986 req-5ffbd4b1-082b-44f9-9883-d71a6050edfb service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:50.867090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-9e2d28cd-3af6-4181-a075-0a5ae4104986 req-5ffbd4b1-082b-44f9-9883-d71a6050edfb service nova] Creating event network-vif-deleted:cccf25dc-9d0e-48a9-907f-37eaa21194a7 for instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d on hv-cinder-84457 Jun 03 12:01:50.873047 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-9e2d28cd-3af6-4181-a075-0a5ae4104986 req-5ffbd4b1-082b-44f9-9883-d71a6050edfb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033884 Jun 03 12:01:50.874547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 194/393] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:01:51.440794 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:51.441426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:51.448846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:51.449485 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:51.450415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:51.450993 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:51.591701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:51.600015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:51.601512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:51.602652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e2b5344f-f835-48ad-b2dd-a154d315e00f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.166540 Jun 03 12:01:51.603212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 200/394] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:51 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:51.734015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:51.734770 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] [instance: 63abc6d6-c330-44ba-8543-39c01ea0ea2d] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:51.741413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:51.741861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:51.742617 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:51.743050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:51.758316 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] HTTP exception thrown: Instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d could not be found. Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Request method failure captured: Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d HTTP/1.1 Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfgT5Wi-kTBxYA_Ku9wWqhEGK7ouAkrvCJODwlpdlCcOXdV0oaYOAau1Y5Jf82nhvjFXi1zBeo3AH_abKSbr-bliV6cz4n-5FQriPFOiNm2TyRVww_1e3fB8HUR_WmXrLyKPyNgwmOIJSTlKvPG0yzm9CT9cNAK1Hnv2ezATp9I6zzc Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 8a84f7c6c96c4a43bf6f2f4a59725156 Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1590529260 Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:01:51.760006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a84f7c6c96c4a43bf6f2f4a59725156"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a84f7c6c96c4a43bf6f2f4a59725156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a84f7c6c96c4a43bf6f2f4a59725156"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a84f7c6c96c4a43bf6f2f4a59725156"}]}] Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1590529260 Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 8a84f7c6c96c4a43bf6f2f4a59725156 Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1590529260 Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1590529260-project Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 89f94b41bbc442d3bc065a0487de7259 Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1590529260-project Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d could not be found. Jun 03 12:01:51.761565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '63abc6d6-c330-44ba-8543-39c01ea0ea2d'} Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d could not be found. Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:01:51.762573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d could not be found. Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d could not be found. Jun 03 12:01:51.764147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:01:51.765449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] Returning 404 to user: Instance 63abc6d6-c330-44ba-8543-39c01ea0ea2d could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:01:51.765449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bcb3bb03-5055-4e77-bfbc-c00ff6721861 tempest-VolumesNegativeTest-1590529260 tempest-VolumesNegativeTest-1590529260-project] 10.222.0.15 "GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d" status: 404 len: 111 microversion: 2.1 time: 0.032424 Jun 03 12:01:51.765449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 195/395] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:01:51 2022] GET /compute/v2.1/servers/63abc6d6-c330-44ba-8543-39c01ea0ea2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:52.620535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:52.621134 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:52.627030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:52.627455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:52.628236 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:52.628666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:52.767686 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:52.777350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:52.778906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:52.780294 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cd11eecc-0843-4291-9ea3-07d4c3c0a442 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.163379 Jun 03 12:01:52.780864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 201/396] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:52 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:53.799710 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:53.800400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:53.807054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:53.807524 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:53.808301 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:53.808738 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:53.942083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:53.952462 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:53.954108 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:53.956942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2f19be61-b22a-4d96-9103-82a58fdbbf11 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.159455 Jun 03 12:01:53.957472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 196/397] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:53 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:54.976378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:54.976976 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:54.982886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:54.983320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:54.984093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:54.984514 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:55.109435 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:55.117783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:55.119274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:55.120429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a78d5f0b-efa5-4c82-bced-f213a33a6b45 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.148589 Jun 03 12:01:55.120980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 202/398] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:54 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:56.138473 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:56.139087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:56.146110 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:56.146553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:56.147624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:56.148085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:56.280561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:56.288911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:56.290393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:56.291545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6dc4880e-43d5-4087-9450-a10b3def0596 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.157111 Jun 03 12:01:56.292086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 197/399] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:56 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:56.793121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:01:56.793632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:01:57.309701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:57.310328 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:57.316420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:57.316855 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:57.317643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:57.318062 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:57.441495 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:57.449208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:57.450687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:57.451839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-deef2da0-f71d-4893-86a7-4810d732c3a6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.145979 Jun 03 12:01:57.452385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 203/400] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:57 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:58.470318 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:58.470928 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:58.477567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:58.478010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:58.478761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:58.479198 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:58.608731 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:58.616596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:58.618099 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:58.619259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-27754902-5fac-48ae-b2cf-d5276b0c0111 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.152842 Jun 03 12:01:58.619829 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 198/401] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:58 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:01:59.637125 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:01:59.637681 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:01:59.643730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:59.644168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:59.644904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:01:59.645410 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:01:59.769963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:59.778171 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:59.779738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:01:59.780897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fda0d7cd-7068-4952-816e-bfe2929475fc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.147711 Jun 03 12:01:59.781430 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 204/402] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:01:59 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:00.799534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:00.800074 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:00.806722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:00.807165 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:00.807987 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:00.808425 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:00.934565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:00.942982 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:00.944518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:00.945681 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-14249458-4a1d-4aa1-b575-b60ba70f59ca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.150142 Jun 03 12:02:00.946216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 199/403] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:00 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:01.963730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:01.964338 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:01.970416 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:01.970862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:01.971644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:01.972079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:02.108375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:02.117302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:02.118946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:02.120140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f11ed6f0-b57d-45e3-8e54-7752be5757dd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1745 microversion: 2.20 time: 0.160497 Jun 03 12:02:02.120687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 205/404] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:01 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:02:03.138382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:03.139015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:03.141510 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:03.147882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:03.148320 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:03.149080 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:03.149520 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:03.282294 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:03.290114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:03.291640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:03.292786 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b0bc7d03-51c1-4b11-ac91-8e8cbadd13e0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1745 microversion: 2.20 time: 0.158328 Jun 03 12:02:03.293347 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 200/405] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:03 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:04.310224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:04.310870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:04.312946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=42 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:04.318719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:04.319159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:04.319940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:04.320365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:04.444662 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:04.452434 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:04.453903 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:04.455037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-985db012-c43a-449b-b9df-172dbfef94a2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1745 microversion: 2.20 time: 0.148798 Jun 03 12:02:04.455604 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 206/406] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:04 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:05.472861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:05.473463 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:05.479894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:05.480337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:05.481086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:05.481516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:05.607289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:05.615529 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:05.617006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:05.618146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8f539f45-d200-4f54-8106-4da94bde5abb tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1745 microversion: 2.20 time: 0.149123 Jun 03 12:02:05.618694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 201/407] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:05 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:05.924765 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-0d57aec7-7028-4c4a-a15c-c29a2d9b8773 req-a01b97e9-9a86-4555-b17b-4acd6bb29aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "name": "network-vif-plugged", "status": "completed", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:05.933987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-0d57aec7-7028-4c4a-a15c-c29a2d9b8773 req-a01b97e9-9a86-4555-b17b-4acd6bb29aaf service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:05.934444 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-0d57aec7-7028-4c4a-a15c-c29a2d9b8773 req-a01b97e9-9a86-4555-b17b-4acd6bb29aaf service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:05.946938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-0d57aec7-7028-4c4a-a15c-c29a2d9b8773 req-a01b97e9-9a86-4555-b17b-4acd6bb29aaf service nova] Creating event network-vif-plugged:afce902f-86ce-4fca-bc6c-a632e1f83134 for instance a5e00459-a0d4-4520-bc60-02901fe74ffe on hv-cinder-84457 Jun 03 12:02:05.951858 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-0d57aec7-7028-4c4a-a15c-c29a2d9b8773 req-a01b97e9-9a86-4555-b17b-4acd6bb29aaf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Jun 03 12:02:05.952438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 207/408] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:02:06.635578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:06.636193 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:06.642773 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:06.643227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:06.644026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:06.644558 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:06.776256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:06.784115 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:06.786140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:06.787268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2d3d4cce-37bd-43ff-8986-a169b9d76e94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1745 microversion: 2.20 time: 0.155590 Jun 03 12:02:06.787888 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 202/409] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:06 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:07.805824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:07.806592 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:07.813725 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:07.814212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:07.815006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:07.815432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:07.952783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:07.963764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:07.965485 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:07.966844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-67b3f4c2-a15e-4214-a5af-aed5ee1c6cfa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.165445 Jun 03 12:02:07.978040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 208/410] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:07 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:08.985084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:08.985817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:08.993226 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:08.993544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:08.994522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:08.995130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:09.148383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:09.160932 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:09.162357 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:09.163579 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-05392b35-e8e0-4702-a2a4-d0530b00bd94 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.182319 Jun 03 12:02:09.172173 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 203/411] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:08 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:10.182515 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:10.183041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:10.189350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:10.189791 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:10.190541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:10.191008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:10.325584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:10.334753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:10.336925 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:10.338198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-870b9827-36ea-40c3-9aeb-0fc963e1bfb3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.159987 Jun 03 12:02:10.345382 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 209/412] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:10 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:11.356080 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:11.356709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:11.363464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:11.363937 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:11.364693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:11.365125 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:11.503663 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:11.513624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:11.515591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:11.517308 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e2a7dd31-ec70-49b0-87de-a8d7e96a5a14 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.165121 Jun 03 12:02:11.517886 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 204/413] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:11 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:12.539345 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:12.540601 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:12.547630 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:12.548172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:12.548967 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:12.549413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:12.693248 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:12.701675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:12.703197 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:12.704383 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f8173330-2c57-4107-8fe9-860a10e7bbe1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.169599 Jun 03 12:02:12.704931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 210/414] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:12 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:13.723044 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:13.723725 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:13.730914 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:13.731362 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:13.732259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:13.732699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:13.879383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:13.887887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:13.889455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:13.890718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72ee5e66-7d80-4e82-a075-92a062be27a9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.172063 Jun 03 12:02:13.891339 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 205/415] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:13 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:14.909976 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:14.911215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:14.921539 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:14.922084 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:14.922941 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:14.923472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:15.058875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:15.067922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:15.069421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:15.070580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f27a3b88-ef5a-4648-b5b7-5019f893bc7e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.164581 Jun 03 12:02:15.071134 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 211/416] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:14 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:16.090197 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:16.091146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:16.097597 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:16.098686 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:16.099478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:16.099926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:16.251337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:16.259424 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:16.260951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:16.262120 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e04797b2-f3c1-40f5-b005-cd3b97fe9d29 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.175990 Jun 03 12:02:16.262664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 206/417] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:16 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:17.280957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:17.281606 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:17.287963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:17.288405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:17.289146 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:17.289576 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:17.293480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=98 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:17.414263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:17.421977 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:17.423462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:17.424619 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-078be326-77f0-4b10-81b9-f832e4339ae1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1740 microversion: 2.20 time: 0.147700 Jun 03 12:02:17.425163 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 212/418] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:17 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:18.443335 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:18.443968 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:18.450440 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:18.450884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:18.451664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:18.452098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:18.454598 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:18.582650 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:18.590391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:18.591907 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:18.593060 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e28fa110-0c22-4734-8ce4-0a7693c2fd9f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1722 microversion: 2.20 time: 0.154163 Jun 03 12:02:18.593628 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 207/419] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:18 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:19.611721 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:19.612329 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:19.618410 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:19.618859 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:19.619641 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:19.620075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:19.751227 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:19.759680 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:19.761157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:19.762279 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4c9fb31c-52b0-4fc9-8036-ca927e703c32 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1722 microversion: 2.20 time: 0.154461 Jun 03 12:02:19.762821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 213/420] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:19 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:20.779685 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:20.780297 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:20.787358 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:20.787839 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:20.788609 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:20.789044 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:20.918496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:20.926312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:20.927840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:20.928992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cd2495af-067f-4b45-b633-461b2998480c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1665 microversion: 2.20 time: 0.153235 Jun 03 12:02:20.929549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 208/421] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:20 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:20.946491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f44b25c2-0ec8-434f-a122-aa29a62e6461"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:20.947562 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:20.953519 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:20.953953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:20.954692 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:20.955116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:21.226027 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-285136d5-ecae-4f74-a712-72f90734f1e7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283401 Jun 03 12:02:21.226637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 214/422] 10.222.0.15 () {62 vars in 1363 bytes} [Fri Jun 3 12:02:20 2022] POST /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:02:21.337839 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:21.338410 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:21.344493 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:21.344994 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:21.345786 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:21.346224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:21.432745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-69920343-7a33-49a8-8dec-0bfdf77e1da9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/action" status: 202 len: 0 microversion: 2.20 time: 0.098848 Jun 03 12:02:21.433356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 209/423] 10.222.0.15 () {62 vars in 1318 bytes} [Fri Jun 3 12:02:21 2022] POST /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:02:21.441383 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:21.442814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:21.448688 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:21.449128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:21.449966 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:21.450392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:21.581765 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:21.589963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:21.591445 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:21.592614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f597206c-f150-4fc4-9724-bf1a3554330e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1751 microversion: 2.20 time: 0.155175 Jun 03 12:02:21.593161 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 215/424] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:21 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:22.073776 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-91a1863e-a3e7-4a17-93fc-3043d4ba195f req-d0da1a2a-1e55-430b-876e-80e1406d55b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:22.091681 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-91a1863e-a3e7-4a17-93fc-3043d4ba195f req-d0da1a2a-1e55-430b-876e-80e1406d55b1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:22.092235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-91a1863e-a3e7-4a17-93fc-3043d4ba195f req-d0da1a2a-1e55-430b-876e-80e1406d55b1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:22.104755 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.compute.server_external_events [req-91a1863e-a3e7-4a17-93fc-3043d4ba195f req-d0da1a2a-1e55-430b-876e-80e1406d55b1 service nova] Unable to find a host for instance a5e00459-a0d4-4520-bc60-02901fe74ffe. Dropping event network-vif-unplugged {{(pid=117618) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 12:02:22.105959 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-91a1863e-a3e7-4a17-93fc-3043d4ba195f req-d0da1a2a-1e55-430b-876e-80e1406d55b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039978 Jun 03 12:02:22.107216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 210/425] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 12:02:22.611217 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:22.611846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:22.617955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:22.618403 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:22.619165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:22.619624 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:22.746711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:22.755754 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:22.757247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:22.758394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-351186e4-14b2-45f7-b648-2eaf82abfa72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1753 microversion: 2.20 time: 0.151023 Jun 03 12:02:22.758944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 216/426] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:22 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:23.778082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:23.778693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:23.786704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:23.787151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:23.787940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:23.788381 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:23.963200 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:23.971802 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:23.973824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:23.975015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-17b0ac8f-1633-4560-8be7-abf0e42e10d1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.200906 Jun 03 12:02:23.975583 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 211/427] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:23 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:02:24.993800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:24.995055 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:25.001372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:25.002009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:25.002779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:25.003209 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:25.164803 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:25.174228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:25.175751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:25.177459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d8ed9c97-3134-4b3a-a091-ab390cf1ef5d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.188436 Jun 03 12:02:25.178183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 217/428] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:24 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:26.196306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:26.196872 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:26.203715 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:26.204163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:26.210594 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:26.211054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:26.343187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:26.369854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:26.371577 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:26.372867 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7bc10405-d7bf-4099-9e46-5fc69e5edc23 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.180553 Jun 03 12:02:26.373492 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 212/429] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:26 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:27.392283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:27.392967 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:27.400884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:27.401560 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:27.402341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:27.402879 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:27.540940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:27.549821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:27.551320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:27.552503 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-932f1ebc-8bde-44c1-b411-ae5626d6e960 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.164849 Jun 03 12:02:27.553056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 218/430] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:27 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:02:28.570767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:28.571380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:28.578299 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:28.578750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:28.579589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:28.579978 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:28.716760 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:28.726868 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:28.728600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:28.730049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c791c07f-100c-4680-b202-b6a78c646e0b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.163575 Jun 03 12:02:28.731010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 213/431] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:28 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:29.749777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:29.750601 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:29.758340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:29.758878 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:29.759766 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:29.760268 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:29.895534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:29.904282 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:29.905762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:29.907014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-70e96b4d-eda1-4eae-b7a8-96017a78f2fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.161861 Jun 03 12:02:29.907576 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 219/432] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:29 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:30.928571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:30.929776 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:30.937404 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:30.938329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:30.939327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:30.939996 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:31.077763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:31.086263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:31.087792 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:31.088948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-17a2dfa6-c110-4b3c-8fb0-64d5be17d221 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.166687 Jun 03 12:02:31.089494 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 214/433] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:30 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:32.108210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:32.109520 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:32.121246 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:32.121695 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:32.122476 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:32.122889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:32.285056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:32.293582 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:32.295056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:32.296224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a1112f0e-15b1-4ba9-99d6-46a56be46769 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.193914 Jun 03 12:02:32.296777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 220/434] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:32 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:33.316492 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:33.317923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:33.329058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=32 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:33.331464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:33.332004 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:33.333574 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:33.334118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:33.464933 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:33.473459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:33.475472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:33.476702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-48a17c6e-cbc0-4cf6-a82d-b369b3228b95 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.166037 Jun 03 12:02:33.477253 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 215/435] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:33 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:34.494061 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:34.494736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:34.500129 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=30 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:34.501591 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:34.502033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:34.502802 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:34.503238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:34.637411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:34.646320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:34.648153 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:34.649274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cd227c09-6073-4d60-86c0-9119f7bc74a3 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.159114 Jun 03 12:02:34.649817 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 221/436] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:34 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:35.666833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:35.667481 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:35.678540 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:35.678987 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:35.679794 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:35.680228 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:35.812374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:35.821130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:35.822622 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:35.823806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c393a14d-abd0-4f0a-81d6-b69af3061c03 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.160911 Jun 03 12:02:35.824371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 216/437] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:35 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:36.842312 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:36.842932 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:36.849349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:36.849784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:36.850629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:36.851058 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:36.975484 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:36.983741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:36.985210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:36.986335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e26bc4c0-e22d-47fd-81d5-bfd63ae7d02e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.147959 Jun 03 12:02:36.986885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 222/438] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:36 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:38.005239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:38.005842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:38.012351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:38.012796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:38.013543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:38.013975 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:38.142252 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:38.150828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:38.152415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:38.153503 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7d0046ca-d550-43e3-8e96-5fb2a19a9683 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.152711 Jun 03 12:02:38.154057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 217/439] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:37 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:39.172042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:39.172563 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:39.179017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:39.179460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:39.180225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:39.180657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:39.303282 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:39.311634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:39.313119 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:39.314254 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fafd24a4-7fb2-49d3-b43e-b9a011e5c498 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.146186 Jun 03 12:02:39.314825 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 223/440] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:39 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:40.331759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:40.333005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:40.339473 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:40.339981 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:40.340739 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:40.341167 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:40.752406 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:40.761459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:40.762949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:40.764205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f1fdcc00-33d0-4bb1-8c30-309772b9b46a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.436305 Jun 03 12:02:40.764899 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 218/441] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:40 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:41.782134 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:41.782673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:41.788777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:41.789218 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:41.789964 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:41.790396 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:41.916745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:41.925574 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:41.926497 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:41.927647 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f00c556b-6b88-4a0c-b09b-fcb483a38cf6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.149427 Jun 03 12:02:41.928195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 224/442] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:41 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:42.946296 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:42.946910 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:42.953550 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:42.953997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:42.954751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:42.955185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:43.082658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:43.087785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55eb5e09-56ef-412d-b0a5-32c93d58f907"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:43.088971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:43.091212 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:43.092729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:43.093872 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c0f2983a-e706-4cb4-b179-6d1742783f1a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.152114 Jun 03 12:02:43.094413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 219/443] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:42 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:43.095031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:43.095471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:43.096250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:43.096679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:43.270801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:43.377862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a8b3dd1d-65d3-4f39-8292-c0263f3aa551 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293989 Jun 03 12:02:43.378499 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 225/444] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:02:43 2022] POST /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:02:44.111628 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:44.112227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:44.119261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:44.119745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:44.120501 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:44.120937 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:44.246084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:44.254398 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:44.255913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:44.257069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-22652cf2-c0da-4fcc-98e7-fc0dfdf6bedd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.149296 Jun 03 12:02:44.257616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 220/445] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:44 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:45.276284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:45.276911 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:45.283068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:45.283583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:45.284358 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:45.284792 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:45.408799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:45.417061 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:45.418567 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:45.419751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7b18af3f-b441-442f-8ad2-08af4d80a912 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.148577 Jun 03 12:02:45.420304 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 226/446] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:45 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:46.437828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:46.438438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:46.445515 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:46.445960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:46.446715 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:46.447153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:46.575700 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:46.584130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:46.585604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:46.586740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c7770998-f3ad-4a5e-b2da-0860a1ea191b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.152860 Jun 03 12:02:46.587304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 221/447] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:46 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:47.604898 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:47.605494 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:47.611798 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:47.612244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:47.612989 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:47.613416 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:47.946090 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:47.954417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:47.955907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:47.957032 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-83eda95a-35ca-4d29-947d-18ca9cad7684 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.355974 Jun 03 12:02:47.958154 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 227/448] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:47 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:48.976561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:48.977176 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:48.983822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:48.984275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:48.985059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:48.985497 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:48.988061 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:49.111978 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:49.120867 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:49.122377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:49.123553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8ce84866-a591-4be7-b9c6-0fd0a5e59938 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.151389 Jun 03 12:02:49.124132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 222/449] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:48 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:50.141472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:50.142086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:50.148886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:50.149336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:50.150091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:50.150522 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:50.192778 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-d1ecda70-aed9-4065-9c52-7316f3f98ccd req-a1ce7dac-49be-4a55-9c4d-ce26bf44b5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "name": "network-vif-plugged", "status": "completed", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:50.210581 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d1ecda70-aed9-4065-9c52-7316f3f98ccd req-a1ce7dac-49be-4a55-9c4d-ce26bf44b5c8 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:50.215958 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d1ecda70-aed9-4065-9c52-7316f3f98ccd req-a1ce7dac-49be-4a55-9c4d-ce26bf44b5c8 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:50.233265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-d1ecda70-aed9-4065-9c52-7316f3f98ccd req-a1ce7dac-49be-4a55-9c4d-ce26bf44b5c8 service nova] Creating event network-vif-plugged:afce902f-86ce-4fca-bc6c-a632e1f83134 for instance a5e00459-a0d4-4520-bc60-02901fe74ffe on hv-cinder-84457 Jun 03 12:02:50.243156 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-d1ecda70-aed9-4065-9c52-7316f3f98ccd req-a1ce7dac-49be-4a55-9c4d-ce26bf44b5c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053833 Jun 03 12:02:50.245973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 223/450] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:02:50.318132 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:50.327057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:50.328616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:50.329767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-eb9da195-5262-4a66-bb9e-9cf4fa52e969 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.192205 Jun 03 12:02:50.330386 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 228/451] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:50 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:50.859736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:02:50.860761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:50.866897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:50.867346 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:50.868141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:50.868576 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:50.892786 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'flavor' on Instance uuid 187129e0-f035-4b58-b3ff-7a6bb94ed536 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:02:51.011790 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0751408b-2348-4aa0-bd40-c0327e0e112a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/action" status: 200 len: 32 microversion: 2.1 time: 0.156313 Jun 03 12:02:51.012374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 224/452] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:02:50 2022] POST /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:02:51.022057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:51.022665 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:51.028677 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:51.029127 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:51.029884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:51.030319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:51.156851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:51.165221 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0c655333-9dcd-47a7-815c-84faabc5acf1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.147711 Jun 03 12:02:51.165775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 229/453] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:51 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:51.348593 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:51.349322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:51.355908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:51.356291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:51.357055 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:51.357492 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:51.483342 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:51.491656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:51.493139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:51.494306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cedfe95d-825b-4a80-8ec1-633dfb19c4a7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.150037 Jun 03 12:02:51.494850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 225/454] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:51 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:52.182957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:52.183564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:52.190079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:52.190516 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:52.191263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:52.191714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:52.317293 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:52.325308 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ef6086d8-a1cb-4ce5-a1ae-8aedcb55cff9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.146194 Jun 03 12:02:52.325875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 230/455] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:52 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:52.512122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:52.512685 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:52.519030 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:52.519473 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:52.520773 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:52.521201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:52.648075 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:52.656303 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:52.657777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:52.658918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-46b7eb75-4c85-43da-8f54-2d285d061478 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1809 microversion: 2.20 time: 0.150756 Jun 03 12:02:52.659468 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 226/456] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:52 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:53.342588 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:53.343321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:53.349851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:53.350298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:53.351048 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:53.351479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:53.480530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:53.488470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b89e98b6-6766-4809-aaed-dbb38cf28056 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.149764 Jun 03 12:02:53.489674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 231/457] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:53 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:53.678242 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:53.678849 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:53.685642 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:53.686023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:53.686785 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:53.687226 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:53.820064 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:53.828323 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:53.829834 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:53.830984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9358781f-ed02-4766-b2ce-5d0390f0c5db tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1796 microversion: 2.20 time: 0.157380 Jun 03 12:02:53.831553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 227/458] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:02:53 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:02:54.506071 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:54.506673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:54.513059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:54.513496 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:54.514241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:54.514662 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:54.642068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:54.650689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-638c316e-fdc4-4cb4-80c6-4302d8c2c058 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.148513 Jun 03 12:02:54.651240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 232/459] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:54 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:55.669138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:55.669741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:55.676206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:55.676653 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:55.677408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:55.677842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:55.805905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:55.813675 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ccf596ae-8a1c-4dcb-915a-051f0c372baf tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.148414 Jun 03 12:02:55.814236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 228/460] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:55 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:56.830906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:56.831530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:56.838520 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:56.838969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:56.839749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:56.840177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:56.964679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:56.972443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a917907c-496b-4e6d-a9ae-bf4d52f44869 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.145384 Jun 03 12:02:56.973019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 233/461] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:56 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:57.989599 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:57.990239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:57.996810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:57.997256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:57.998006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:57.998443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:58.124433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:58.132842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fd7238a5-c94b-41b4-843b-9092b6eeae0c tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.147260 Jun 03 12:02:58.133397 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 229/462] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:57 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:02:59.150162 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:02:59.150832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:02:59.157454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:59.157847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:59.158597 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:02:59.159056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:02:59.285014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:02:59.292806 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b59382df-fbbf-4a33-832f-2e6f7f49f9c8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.146739 Jun 03 12:02:59.293356 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 234/463] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:02:59 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:00.309799 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:00.310414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:00.316998 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:00.317446 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:00.318209 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:00.318648 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:00.450078 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:00.458685 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4cddceaf-4ac1-45ab-aba2-26894de03686 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.152716 Jun 03 12:03:00.459250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 230/464] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:00 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:01.475607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:01.476218 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:01.482704 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:01.483150 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:01.483931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:01.484368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:01.608781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:01.617231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-aa5fd22d-c6c7-450b-915a-5f7ae1c28b0f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.145478 Jun 03 12:03:01.617790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 235/465] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:01 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:02.634470 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:02.635083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:02.641646 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:02.642098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:02.642853 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:02.643293 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:02.771053 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:02.779828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d04dbf44-13e6-4b32-8323-ebf87a2599c7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.149123 Jun 03 12:03:02.780484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 231/466] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:02 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:03.797169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:03.797773 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:03.804961 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:03.805407 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:03.806157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:03.806585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:03.933730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:03.941574 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1d259a5d-9c60-455f-8596-55ac76d959d4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.148213 Jun 03 12:03:03.942133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 236/467] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:03 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:04.959059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:04.959705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:04.962223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=34 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:04.967615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:04.968064 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:04.968822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:04.969258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:05.126759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:05.135237 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-db08cfc7-f46f-46a4-bda6-ee4ce975bb19 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.180624 Jun 03 12:03:05.135822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 232/468] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:04 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:06.152554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:06.153082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:06.155415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=32 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:06.161274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:06.161713 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:06.162454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:06.162880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:06.292913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:06.300743 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e4ddaec6-7df2-44c9-bdd3-4120406fcba6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1734 microversion: 2.1 time: 0.151970 Jun 03 12:03:06.301796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 237/469] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:06 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:03:07.317929 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:07.318461 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:07.324961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.325407 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.326162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.326596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.455907 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:07.464241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3e9db667-d51f-4b8a-8419-a308f955e6f4 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1714 microversion: 2.1 time: 0.150289 Jun 03 12:03:07.464834 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 233/470] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:07 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:07.564416 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:07.564901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:07.571249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.571682 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.572438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.572870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.691927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] HTTP exception thrown: Cannot 'detach_volume' instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 while it is in vm_state rescued Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Request method failure captured: Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments/55eb5e09-56ef-412d-b0a5-32c93d58f907 HTTP/1.1 Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfduedHNt1m7wblLZ9kOTIzLGXSMupGli3zb3RkbS-guY0WE5PnKCpv-w_uck9rKeOOuChQzR99EbSnYRFXFztFcVb3535efxUgctS-SzVU9VaBjG1MiQbh9c-zhMuUaCD-hv8WFiLT8tIego4vD4IoGmr9TgGeB3X-Ykx1ugCRw1Tc Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:03:07.694068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_799fb68a55084528ab5573051a1bf121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/799fb68a55084528ab5573051a1bf121"}]}] Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: abcc58cb66804297b184e41726c281bb Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:03:07.695699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Cannot 'detach_volume' instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 while it is in vm_state rescued Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'server_id': '187129e0-f035-4b58-b3ff-7a6bb94ed536', 'id': '55eb5e09-56ef-412d-b0a5-32c93d58f907'} Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:03:07.696512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 while it is in vm_state rescued Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 while it is in vm_state rescued Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:03:07.697736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Returning 409 to user: Cannot 'detach_volume' instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 while it is in vm_state rescued {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:03:07.698712 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b3c12849-45a9-4b1f-b598-2195deed0bf2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments/55eb5e09-56ef-412d-b0a5-32c93d58f907" status: 409 len: 152 microversion: 2.1 time: 0.134989 Jun 03 12:03:07.698712 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 238/471] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:03:07 2022] DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments/55eb5e09-56ef-412d-b0a5-32c93d58f907 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 12:03:07.704274 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:07.704802 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:07.711336 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.711816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.712559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.712988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.776962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a881f4d7-b03b-4c2a-9cba-a20c021c03f8 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "POST /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/action" status: 202 len: 0 microversion: 2.1 time: 0.076097 Jun 03 12:03:07.777565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 234/472] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:03:07 2022] POST /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 12:03:07.785757 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:07.786404 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:07.793123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.793599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.794426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:07.795195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:07.926069 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:07.934096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a357b97a-736e-4cbe-93b3-a736c18ccbdc tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1722 microversion: 2.1 time: 0.152264 Jun 03 12:03:07.934746 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 239/473] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:07 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:08.952681 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:08.953372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:08.960475 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:08.960919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:08.961667 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:08.962096 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:09.093132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:09.101632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7f0cfe56-031d-4897-9465-5bd367740c4f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1722 microversion: 2.1 time: 0.153176 Jun 03 12:03:09.102175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 235/474] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:08 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:10.118813 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:10.119420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:10.125839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:10.126278 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:10.127024 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:10.127453 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:10.255284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:10.263071 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4d15ac90-dc5a-4b92-84be-25630afa04a6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1722 microversion: 2.1 time: 0.148853 Jun 03 12:03:10.263650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 240/475] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:10 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:11.280901 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:11.281428 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:11.287956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:11.288408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:11.289169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:11.289607 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:11.304582 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:11.418257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:11.426118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5ea8c633-a717-4414-8639-e8273dfcecdb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1728 microversion: 2.1 time: 0.149142 Jun 03 12:03:11.427291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 236/476] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:11 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:11.443179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:11.443744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:11.450067 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:11.450517 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:11.451268 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:11.451733 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:11.465235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:11.531413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6f36a7c9-139b-4f47-a82a-4455d0c1897d tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091877 Jun 03 12:03:11.531978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 241/477] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:03:11 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:03:12.361614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-daefec30-7cc2-4a9e-8d83-940a62e1b070 req-964f95c5-0ca5-4b0c-bb26-906ddddfe75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187129e0-f035-4b58-b3ff-7a6bb94ed536", "tag": "edce147b-e88b-4b4e-9723-100efdf1322f"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:12.373432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-daefec30-7cc2-4a9e-8d83-940a62e1b070 req-964f95c5-0ca5-4b0c-bb26-906ddddfe75d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:12.373876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-daefec30-7cc2-4a9e-8d83-940a62e1b070 req-964f95c5-0ca5-4b0c-bb26-906ddddfe75d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:12.387479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-daefec30-7cc2-4a9e-8d83-940a62e1b070 req-964f95c5-0ca5-4b0c-bb26-906ddddfe75d service nova] Creating event network-changed:edce147b-e88b-4b4e-9723-100efdf1322f for instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 on hv-cinder-84457 Jun 03 12:03:12.392665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-daefec30-7cc2-4a9e-8d83-940a62e1b070 req-964f95c5-0ca5-4b0c-bb26-906ddddfe75d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Jun 03 12:03:12.393377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 237/478] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:03:14.407479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-16fa1962-ddae-4565-bb55-a727288b88f5 req-d0a9b8df-f896-44f8-bd0e-850be5c83907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187129e0-f035-4b58-b3ff-7a6bb94ed536", "tag": "edce147b-e88b-4b4e-9723-100efdf1322f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:14.415930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-16fa1962-ddae-4565-bb55-a727288b88f5 req-d0a9b8df-f896-44f8-bd0e-850be5c83907 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:14.416368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-16fa1962-ddae-4565-bb55-a727288b88f5 req-d0a9b8df-f896-44f8-bd0e-850be5c83907 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:14.427570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-16fa1962-ddae-4565-bb55-a727288b88f5 req-d0a9b8df-f896-44f8-bd0e-850be5c83907 service nova] Creating event network-changed:edce147b-e88b-4b4e-9723-100efdf1322f for instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 on hv-cinder-84457 Jun 03 12:03:14.432446 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-16fa1962-ddae-4565-bb55-a727288b88f5 req-d0a9b8df-f896-44f8-bd0e-850be5c83907 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029211 Jun 03 12:03:14.433025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 242/479] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:03:42.109411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:03:42.110023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:03:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:03:46.136053 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:03:46.136539 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:03:49.347519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=11 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:49.348329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=5 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:49.453420 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:49.454000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:49.460068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:49.460511 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:49.461258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:49.461684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:49.491377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ac33db84-a387-46f1-9bcf-d28d884d7892 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments/f44b25c2-0ec8-434f-a122-aa29a62e6461" status: 200 len: 194 microversion: 2.20 time: 0.145532 Jun 03 12:03:49.491946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 238/480] 10.222.0.15 () {60 vars in 1453 bytes} [Fri Jun 3 12:03:49 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments/f44b25c2-0ec8-434f-a122-aa29a62e6461 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:03:49.550207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=11 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:49.551005 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:49.555655 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:49.556230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:49.562958 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:49.563398 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:49.564162 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:49.564585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:49.740550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lazy-loading 'services' on Instance uuid a5e00459-a0d4-4520-bc60-02901fe74ffe {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:03:49.847800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-99111b49-c9eb-46f4-a658-5870903caf35 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments/f44b25c2-0ec8-434f-a122-aa29a62e6461" status: 202 len: 0 microversion: 2.20 time: 0.298931 Jun 03 12:03:49.848349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 243/481] 10.222.0.15 () {60 vars in 1456 bytes} [Fri Jun 3 12:03:49 2022] DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments/f44b25c2-0ec8-434f-a122-aa29a62e6461 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:03:49.857292 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:49.858181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:49.865304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:49.865820 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:49.866716 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:49.867163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:49.899143 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1f8da9f3-3cdf-4495-b39c-3d6c0f8d9dfe tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045857 Jun 03 12:03:49.899737 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 239/482] 10.222.0.15 () {60 vars in 1342 bytes} [Fri Jun 3 12:03:49 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:03:50.911523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:50.912595 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:50.918783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:50.919223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:50.920009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:50.920442 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:50.951910 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2dc090ba-1230-4152-aa83-64cc33d35a4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045259 Jun 03 12:03:50.952467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 244/483] 10.222.0.15 () {60 vars in 1342 bytes} [Fri Jun 3 12:03:50 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:03:51.963400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:51.964344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:51.970562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:51.971000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:51.971780 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:51.972210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:52.000296 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b56e8bf5-a010-4832-a5ef-0b5fd05d9ca6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040821 Jun 03 12:03:52.000827 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 240/484] 10.222.0.15 () {60 vars in 1342 bytes} [Fri Jun 3 12:03:51 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:52.057461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:52.057992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:52.064271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:52.064712 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:52.065450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:52.065871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:52.089349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:03:52.162402 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fb002a4f-4b8e-43f0-88d8-33369b7a0e07 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 204 len: 0 microversion: 2.20 time: 0.108277 Jun 03 12:03:52.163022 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 245/485] 10.222.0.15 () {60 vars in 1279 bytes} [Fri Jun 3 12:03:52 2022] DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 12:03:52.171137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:52.171766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:52.178707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:52.179158 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:52.179947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:52.180387 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:52.360291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:52.368082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:52.369558 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:52.370700 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7f3d6d4a-8796-4637-8f8f-6928e7486c0c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.203436 Jun 03 12:03:52.371242 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 241/486] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:03:52 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:03:53.389189 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:53.389891 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:53.397187 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:53.397635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:53.398389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:53.398821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:53.525249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:53.533140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:53.534628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:53.535793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c0b50879-7450-4063-8a6d-983115307699 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.151055 Jun 03 12:03:53.536370 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 246/487] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:03:53 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:03:54.554448 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:54.554988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:54.561535 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:54.561977 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:54.562737 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:54.563167 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:54.758878 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:54.766746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:54.768269 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:54.769454 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c9ee57fb-a9f7-4b24-a937-04060f7a36ff tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 200 len: 1724 microversion: 2.20 time: 0.219588 Jun 03 12:03:54.770038 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 242/488] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:03:54 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:03:55.214380 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-259b9f35-6b49-400b-ab0c-a8513db4bc8a req-d50ffe3a-99b8-4392-9a9d-9f00acff8d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e00459-a0d4-4520-bc60-02901fe74ffe", "name": "network-vif-deleted", "tag": "afce902f-86ce-4fca-bc6c-a632e1f83134"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:55.223141 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-259b9f35-6b49-400b-ab0c-a8513db4bc8a req-d50ffe3a-99b8-4392-9a9d-9f00acff8d41 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:55.223668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-259b9f35-6b49-400b-ab0c-a8513db4bc8a req-d50ffe3a-99b8-4392-9a9d-9f00acff8d41 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:55.234480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-259b9f35-6b49-400b-ab0c-a8513db4bc8a req-d50ffe3a-99b8-4392-9a9d-9f00acff8d41 service nova] Creating event network-vif-deleted:afce902f-86ce-4fca-bc6c-a632e1f83134 for instance a5e00459-a0d4-4520-bc60-02901fe74ffe on hv-cinder-84457 Jun 03 12:03:55.240029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-259b9f35-6b49-400b-ab0c-a8513db4bc8a req-d50ffe3a-99b8-4392-9a9d-9f00acff8d41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092406 Jun 03 12:03:55.241206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 247/489] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:03:55.789482 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:55.790085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:55.796948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:55.797560 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:55.798317 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:55.798748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:55.812965 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] HTTP exception thrown: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Request method failure captured: Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe HTTP/1.1 Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdsvAlVyk-Urqywe3zaRNKCmLbip6yhDt0hqmBqLGgi17ICqR_CqUPwJKNct_5EqfkgVeYg7k9eIHiLoTem7wJ4sxUFMBKylcxsjQ_xAxc21mVrwv1F44nOrmWGRFQp9VzumRmHd4iUrdi1OcZ5oMTgytj-Ju9Op2xoe4VohWlqlGk Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 89467b1c15334264bf384b711292808b Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:03:55.814680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_89467b1c15334264bf384b711292808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/89467b1c15334264bf384b711292808b"}]}] Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 89467b1c15334264bf384b711292808b Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: b76f9ea7268a4e70a402f3c9ea6220e7 Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:03:55.816389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'a5e00459-a0d4-4520-bc60-02901fe74ffe'} Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:03:55.817422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:03:55.818924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:03:55.820236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Returning 404 to user: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:03:55.820236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4bd95c33-4786-4d6c-8653-1a6cc7351dcd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 404 len: 111 microversion: 2.20 time: 0.031302 Jun 03 12:03:55.820236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 243/490] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:03:55 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:03:55.825875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-11b70a4d-fc3c-4199-bf2e-6bcab133081f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '.version_select at 0x7f19c5bd01f0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:55.848922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-11b70a4d-fc3c-4199-bf2e-6bcab133081f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104863110" status: 204 len: 0 microversion: 2.20 time: 0.026617 Jun 03 12:03:55.849503 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 248/491] 10.222.0.15 () {60 vars in 1258 bytes} [Fri Jun 3 12:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104863110 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 12:03:56.092514 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:56.093319 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:56.102546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:56.103000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:56.103814 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:56.104557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:56.140676 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lazy-loading 'flavor' on Instance uuid df0736cf-da48-4947-8e88-687dd441a9c2 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:03:56.247887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-31907c5e-4275-45c5-b1c3-721a1503bdc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "POST /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.158802 Jun 03 12:03:56.248698 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 244/492] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:03:56 2022] POST /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 12:03:56.263373 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:56.266972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:56.287491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:56.290895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:56.292377 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:56.294353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:56.507857 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:56.516618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8f9df37c-bc50-49d3-b824-f655a50df0d3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.262704 Jun 03 12:03:56.517317 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 249/493] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:56 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:56.656883 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ebfa8340-282b-4532-ad4f-0cf4b022f385 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'create', calling method: .version_select at 0x7f19c63b6ee0>, body: {"keypair": {"name": "tempest-keypair-1790293578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk+NKptBXcwvAID9zPOizkmAZwiYclurFmw0vY6B6B/gVdHaPnh2rQ0S5ezERrLtOq+Fal+diNEz156/d8ZUDLOI30738PHO6eDbh1on8JahiysY/9+Pnao+ceTlnzFBA=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:56.670737 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-ebfa8340-282b-4532-ad4f-0cf4b022f385 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for project 89467b1c15334264bf384b711292808b. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:03:56.674559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-ebfa8340-282b-4532-ad4f-0cf4b022f385 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for user b76f9ea7268a4e70a402f3c9ea6220e7 and project 89467b1c15334264bf384b711292808b. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:03:56.699384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ebfa8340-282b-4532-ad4f-0cf4b022f385 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046721 Jun 03 12:03:56.700213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 245/494] 10.222.0.15 () {62 vars in 1199 bytes} [Fri Jun 3 12:03:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 12:03:57.535826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:57.536436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:57.544172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:57.545336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:57.546123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:57.546556 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:57.693223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:57.703077 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f8a8b187-4e5a-4c5f-8dfc-b0344aff3347 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.171312 Jun 03 12:03:57.709521 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 250/495] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:57 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:57.984805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2134762611", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b38da822-736c-4493-ac79-a664e16e017e"}], "security_groups": [{"name": "tempest-securitygroup--1884738099"}], "key_name": "tempest-keypair-1790293578", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:03:58.083809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] validate_networks() for [('b38da822-736c-4493-ac79-a664e16e017e', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:03:58.495131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:03:58.495577 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:03:58.496046 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:03:58.496447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:03:58.496879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:03:58.505980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:58.506418 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:58.507197 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:58.507660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:58.524379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for project 89467b1c15334264bf384b711292808b. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:03:58.528245 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Getting quotas for user b76f9ea7268a4e70a402f3c9ea6220e7 and project 89467b1c15334264bf384b711292808b. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:03:58.538747 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:03:58.541042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:03:58.586989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dc6ca500-f047-42ee-9a83-f9f97991bbbf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.607039 Jun 03 12:03:58.587657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 246/496] 10.222.0.15 () {62 vars in 1187 bytes} [Fri Jun 3 12:03:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 12:03:58.597843 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e658df1e-46ed-4b9e-bf80-7f1b2bcb55a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:58.599216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e658df1e-46ed-4b9e-bf80-7f1b2bcb55a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:58.654053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e658df1e-46ed-4b9e-bf80-7f1b2bcb55a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:58.661581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e658df1e-46ed-4b9e-bf80-7f1b2bcb55a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:58.663089 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e658df1e-46ed-4b9e-bf80-7f1b2bcb55a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:58.664195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e658df1e-46ed-4b9e-bf80-7f1b2bcb55a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1282 microversion: 2.20 time: 0.070562 Jun 03 12:03:58.664752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 251/497] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:03:58 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:03:58.720496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:58.721119 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:58.728373 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:58.728940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:58.729709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:58.730147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:58.868188 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:58.876443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aa5fe19b-b862-4194-872a-8e3c9a68a330 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.159765 Jun 03 12:03:58.877003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 247/498] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:58 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:03:59.682087 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:59.682665 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:59.689770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:59.690217 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:59.690985 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:59.691416 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:59.758567 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:59.768042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:59.771034 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:03:59.773661 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f3f0dfd9-ca5a-424e-bde8-eb6928f6ffe9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1342 microversion: 2.20 time: 0.095213 Jun 03 12:03:59.774844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 252/499] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:03:59 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:03:59.893865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:03:59.894528 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:03:59.901878 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:59.902327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:03:59.903079 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:03:59.903527 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:00.103326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:00.110772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-19965bdc-93d0-4981-a595-4d401e5b79e5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.220806 Jun 03 12:04:00.111322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 248/500] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:03:59 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:00.793461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:00.793995 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:00.800388 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:00.800827 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:00.801581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:00.802006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:00.939610 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:00.947986 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:00.949456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:00.950540 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2ae888d7-5750-4176-9d48-5e982bfb4378 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.161799 Jun 03 12:04:00.951126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 253/501] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:00 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:01.128221 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:01.129023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:01.137398 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:01.137836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:01.138614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:01.139077 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:01.336157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-b8ffc0b4-58bb-45cd-bee3-c5c4cee342ea req-593b2244-1fab-4757-b708-bb4e178bf12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:01.351424 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-b8ffc0b4-58bb-45cd-bee3-c5c4cee342ea req-593b2244-1fab-4757-b708-bb4e178bf12d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:01.352157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-b8ffc0b4-58bb-45cd-bee3-c5c4cee342ea req-593b2244-1fab-4757-b708-bb4e178bf12d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:01.358324 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:01.368128 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-763eb40b-a1ff-41a8-ba37-ed9bb94530fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.243736 Jun 03 12:04:01.368702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 249/502] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:01 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:01.380833 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-b8ffc0b4-58bb-45cd-bee3-c5c4cee342ea req-593b2244-1fab-4757-b708-bb4e178bf12d service nova] Creating event network-changed:92dddd28-a98f-47bd-a228-483608919ed6 for instance 2694de28-e6b8-4a9c-b13b-74192112056c on hv-cinder-84457 Jun 03 12:04:01.392264 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-b8ffc0b4-58bb-45cd-bee3-c5c4cee342ea req-593b2244-1fab-4757-b708-bb4e178bf12d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060212 Jun 03 12:04:01.393109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 254/503] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:01.968984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:01.969617 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:01.976464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:01.976913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:01.977677 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:01.978127 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:02.105107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:02.112940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:02.114441 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:02.115565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8c0f933d-4c76-452e-b3ff-cc698f739358 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.150523 Jun 03 12:04:02.116114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 250/504] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:01 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:02.386598 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:02.387298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:02.393502 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:02.393950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:02.394701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:02.395791 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:02.522936 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:02.530325 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f68b6ff2-bbed-4a5a-9bc3-e3c07a11549e tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.148374 Jun 03 12:04:02.530877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 255/505] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:02 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:03.133153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:03.133782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:03.140262 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:03.140702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:03.141449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:03.141882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:03.266276 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:03.274361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:03.275875 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:03.276957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-adb76afb-c845-4f9e-b33e-fee95db0691c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.147708 Jun 03 12:04:03.277498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 251/506] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:03 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:03.547053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:03.547639 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:03.554066 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:03.554509 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:03.555260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:03.555719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:03.683672 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:03.691299 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3ce22e85-3506-4f70-bc92-fcc9db14fcd6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.148071 Jun 03 12:04:03.691891 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 256/507] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:03 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:04.294184 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:04.294819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:04.301366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:04.301808 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:04.302627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:04.303059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:04.512380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:04.520134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:04.522402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:04.523519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ac276399-7949-41e3-8bb6-b38b7de325fa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.233301 Jun 03 12:04:04.524083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 252/508] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:04 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:04.709174 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:04.709784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:04.716508 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:04.716952 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:04.717714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:04.718145 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:04.853703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:04.861174 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-971aa398-a58e-429f-a269-8908eab7cf18 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.156597 Jun 03 12:04:04.861739 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 257/509] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:04 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:05.541381 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:05.542003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:05.548394 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:05.548833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:05.549578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:05.550008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:05.677926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:05.685659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:05.687162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:05.688292 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cec568e6-7ba7-4b7b-8b49-4a6e2d55ee72 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.150924 Jun 03 12:04:05.688833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 253/510] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:05 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:05.877897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:05.878564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:05.885529 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:05.885970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:05.886717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:05.887148 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:06.013631 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:06.020989 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ce8dd2c4-80f7-4998-aaa9-dfb3317b135c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.146949 Jun 03 12:04:06.021826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 258/511] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:05 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:06.705877 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:06.706479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:06.713729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:06.714250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:06.715051 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:06.715494 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:06.912486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:06.916005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:06.921583 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:06.923087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:06.924368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-68fcd504-44a5-4d03-afcf-f1180e4cf1d6 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.222185 Jun 03 12:04:06.925633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 254/512] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:06 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:07.040561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:07.041836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:07.048869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.049807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.051557 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.052544 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.127325 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:07.127840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:07.134863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.135306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.136085 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.136510 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.200819 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:07.208626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-10424420-cd66-4b90-93a1-8e4ac95b91e9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.174735 Jun 03 12:04:07.209184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 259/513] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:07 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:07.259625 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'services' on Instance uuid 187129e0-f035-4b58-b3ff-7a6bb94ed536 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:04:07.368360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d0ca5753-42fc-455d-8542-b4d9d0160f1a tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments/55eb5e09-56ef-412d-b0a5-32c93d58f907" status: 202 len: 0 microversion: 2.1 time: 0.245300 Jun 03 12:04:07.368940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 255/514] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:04:07 2022] DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments/55eb5e09-56ef-412d-b0a5-32c93d58f907 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 12:04:07.377288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:07.378234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:07.384737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.385175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.385916 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.386340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.402468 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:07.416429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2de8bde4-3a18-41ed-8efd-e2e140da60d6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 Jun 03 12:04:07.416992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 260/515] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:04:07 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:07.941902 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:07.942646 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:07.948905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.949355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:07.950108 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:07.950573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:08.080429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:08.088843 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:08.090331 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:08.091427 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d60f6156-31f7-4351-9bc9-fc9f78dafe87 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.154205 Jun 03 12:04:08.092032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 256/516] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:07 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:08.226731 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:08.227313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:08.234131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:08.234569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:08.235310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:08.235752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:08.364014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:08.382126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-14c07b7b-e972-45d1-bcbd-d8b8ad5e7412 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.159791 Jun 03 12:04:08.382708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 261/517] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:08 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:08.428053 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:08.431623 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:08.438202 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:08.438863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:08.439657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:08.440071 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:08.471845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-80d0b7eb-c436-4030-9e71-26d9544edcf3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Jun 03 12:04:08.472411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 257/518] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:04:08 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:08.535471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-a9977a8d-8a47-4324-a650-ba71f5115952 req-d416a618-7a59-43fa-a9da-7ef6641a353b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "name": "network-vif-plugged", "status": "completed", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:08.544096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-a9977a8d-8a47-4324-a650-ba71f5115952 req-d416a618-7a59-43fa-a9da-7ef6641a353b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:08.545194 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-a9977a8d-8a47-4324-a650-ba71f5115952 req-d416a618-7a59-43fa-a9da-7ef6641a353b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:08.555803 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-a9977a8d-8a47-4324-a650-ba71f5115952 req-d416a618-7a59-43fa-a9da-7ef6641a353b service nova] Creating event network-vif-plugged:92dddd28-a98f-47bd-a228-483608919ed6 for instance 2694de28-e6b8-4a9c-b13b-74192112056c on hv-cinder-84457 Jun 03 12:04:08.560527 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-a9977a8d-8a47-4324-a650-ba71f5115952 req-d416a618-7a59-43fa-a9da-7ef6641a353b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084288 Jun 03 12:04:08.561089 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 262/519] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:09.109665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:09.110273 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:09.112218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:09.112867 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=10 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:09.119758 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:09.120205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:09.120961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:09.121400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:09.325900 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:09.333852 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:09.335272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:09.336401 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fc8b2691-96b7-4e1d-9081-72e66f306aea tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.230729 Jun 03 12:04:09.336945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 258/520] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:09 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:09.395739 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:09.400824 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:09.401533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:09.408005 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:09.408443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:09.409188 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:09.409617 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:09.484036 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:09.485333 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:09.490838 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:09.491524 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:09.492305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:09.492767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:09.527667 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e72759c9-131c-48c5-9d85-8f2f4541fa08 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Jun 03 12:04:09.528241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 259/521] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:04:09 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:09.547426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:09.555958 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d1ac48df-2b9f-41ad-88af-43456986eec1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.161193 Jun 03 12:04:09.556504 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 263/522] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:09 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:10.354499 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:10.355116 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.361431 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.361887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.362647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.363076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.490217 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:10.497977 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:10.499456 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:10.500565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-713bab8c-33bc-4cdd-8d6d-af7cae7e7b8a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1408 microversion: 2.20 time: 0.150199 Jun 03 12:04:10.501108 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 260/523] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:10 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:10.539118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:10.540057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.546461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.546896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.547665 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.548091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.573235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:10.573847 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.576230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b0d99539-e88a-4a25-b160-ab3b7ff517db tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040902 Jun 03 12:04:10.576768 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 264/524] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:04:10 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:04:10.580230 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.580673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.581644 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.582073 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.647206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:10.647734 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.653636 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.654074 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.654823 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.655249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.682169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:04:10.720501 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:10.729180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d9b3fd81-3620-4184-a632-34f655ebf444 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1569 microversion: 2.1 time: 0.159588 Jun 03 12:04:10.729742 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 261/525] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:10 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:10.749063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:10.749750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.756507 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.756959 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.757870 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.758619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.760204 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4f347516-066b-4ed7-9553-67c794e906fa tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 204 len: 0 microversion: 2.1 time: 0.116834 Jun 03 12:04:10.764264 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 265/526] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:04:10 2022] DELETE /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 12:04:10.769868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:10.770805 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.777505 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.777949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.778776 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.779191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.856287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3dcf204d-df5b-4b91-9c80-fad9e02751bf tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "POST /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.112494 Jun 03 12:04:10.857151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 262/527] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:04:10 2022] POST /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 12:04:10.865672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:10.866293 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:10.873348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.874036 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.874991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:10.875598 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:10.951764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:10.961944 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1047ae33-716b-4e8c-95d0-b5f4d55c1f41 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1688 microversion: 2.1 time: 0.196152 Jun 03 12:04:10.962522 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 266/528] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:10 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:11.016649 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:11.025161 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4aceb8a0-8d40-495c-84b4-c1dba1a72474 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1517 microversion: 2.1 time: 0.163918 Jun 03 12:04:11.025715 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 263/529] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:10 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:11.518593 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:11.519190 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:11.526452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:11.526892 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:11.527687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:11.528134 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:11.656787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:11.664661 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:11.666178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:11.667342 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-81ada7ee-821e-4c6e-af9a-2e7a4ae9819d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1600 microversion: 2.20 time: 0.152659 Jun 03 12:04:11.667932 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 267/530] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:04:11 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:04:11.684686 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:11.685179 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:11.691518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:11.691988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:11.693376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:11.693806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:11.768273 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-224843e0-faae-4c86-bcf7-ac11abe38c75 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087416 Jun 03 12:04:11.768887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 264/531] 10.222.0.15 () {60 vars in 1315 bytes} [Fri Jun 3 12:04:11 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:04:11.978603 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:11.979198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:11.985101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:11.985545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:11.986621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:11.987054 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:12.042602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:12.043134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:12.049540 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:12.050246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:12.051014 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:12.052189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:12.117631 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:12.125212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4fe56f58-fae1-4dd0-9a6d-66a6a5873125 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1688 microversion: 2.1 time: 0.150425 Jun 03 12:04:12.125760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 268/532] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:11 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:12.299960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:12.308526 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-865f6ab1-1618-48bb-a761-49aa797147bc tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1517 microversion: 2.1 time: 0.269961 Jun 03 12:04:12.309407 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 265/533] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:12 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:12.435545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-6cb33958-a7e5-47d1-85ca-0595f7901d77 req-8e87818b-5738-4b6d-8bb1-296049579c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "name": "network-vif-unplugged", "status": "completed", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:12.443275 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-6cb33958-a7e5-47d1-85ca-0595f7901d77 req-8e87818b-5738-4b6d-8bb1-296049579c92 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:12.443727 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-6cb33958-a7e5-47d1-85ca-0595f7901d77 req-8e87818b-5738-4b6d-8bb1-296049579c92 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:12.455033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.compute.server_external_events [req-6cb33958-a7e5-47d1-85ca-0595f7901d77 req-8e87818b-5738-4b6d-8bb1-296049579c92 service nova] Unable to find a host for instance df0736cf-da48-4947-8e88-687dd441a9c2. Dropping event network-vif-unplugged {{(pid=117617) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 12:04:12.455872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-6cb33958-a7e5-47d1-85ca-0595f7901d77 req-8e87818b-5738-4b6d-8bb1-296049579c92 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024191 Jun 03 12:04:12.456642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 269/534] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 25 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 12:04:12.750794 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-0fc12094-c9f0-42ad-ac4e-1c35836384b0 req-8410fbc9-d090-47ae-b293-392ff0bd0590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:12.759721 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-0fc12094-c9f0-42ad-ac4e-1c35836384b0 req-8410fbc9-d090-47ae-b293-392ff0bd0590 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:12.760157 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-0fc12094-c9f0-42ad-ac4e-1c35836384b0 req-8410fbc9-d090-47ae-b293-392ff0bd0590 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:12.772008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-0fc12094-c9f0-42ad-ac4e-1c35836384b0 req-8410fbc9-d090-47ae-b293-392ff0bd0590 service nova] Creating event network-changed:92dddd28-a98f-47bd-a228-483608919ed6 for instance 2694de28-e6b8-4a9c-b13b-74192112056c on hv-cinder-84457 Jun 03 12:04:12.777348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-0fc12094-c9f0-42ad-ac4e-1c35836384b0 req-8410fbc9-d090-47ae-b293-392ff0bd0590 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030146 Jun 03 12:04:12.779342 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 266/535] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:13.142154 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:13.142766 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:13.149459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:13.149906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:13.150715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:13.151087 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:13.279653 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:13.287816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-324cda56-76ab-4b5e-9be7-a967f9ed79e3 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1688 microversion: 2.1 time: 0.149446 Jun 03 12:04:13.288372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 270/536] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:13 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:13.325541 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:13.326236 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:13.332339 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:13.332778 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:13.334051 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:13.334479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:13.465941 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:13.474183 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-379f328f-e66f-42fb-af1b-2d898b6682d6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1517 microversion: 2.1 time: 0.152267 Jun 03 12:04:13.474755 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 267/537] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:13 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:14.305200 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:14.305810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:14.312261 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:14.312706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:14.313458 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:14.313926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:14.440582 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:14.448048 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-766780d0-3dba-4699-a72b-663eebf5e00f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1688 microversion: 2.1 time: 0.147125 Jun 03 12:04:14.448611 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 271/538] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:14 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:14.491142 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:14.491804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:14.498162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:14.498610 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:14.499364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:14.499831 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:14.833936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:14.841705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d07628c2-1063-483a-b4bc-782fb946110f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1519 microversion: 2.1 time: 0.354930 Jun 03 12:04:14.842466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 268/539] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:14 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1519 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:15.464732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:15.465339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:15.472256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:15.472708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:15.473507 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:15.473955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:15.611579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:15.620329 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-56c5622b-32da-48d7-a4dc-0208a7b9be7e tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1688 microversion: 2.1 time: 0.159400 Jun 03 12:04:15.620889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 272/540] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:15 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:15.859312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:15.859889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:15.866870 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:15.867317 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:15.868100 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:15.868539 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:16.203552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:16.211660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a72da198-de16-4658-9961-4eba0065bae9 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.356154 Jun 03 12:04:16.221450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 269/541] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:15 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:16.240469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-269a3937-df31-48e2-b239-e3af60711cbe req-95442760-5074-4963-b388-4005e49d7dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187129e0-f035-4b58-b3ff-7a6bb94ed536", "name": "network-vif-deleted", "tag": "edce147b-e88b-4b4e-9723-100efdf1322f"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:16.249942 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-269a3937-df31-48e2-b239-e3af60711cbe req-95442760-5074-4963-b388-4005e49d7dbd service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:16.250385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-269a3937-df31-48e2-b239-e3af60711cbe req-95442760-5074-4963-b388-4005e49d7dbd service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:16.262747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-269a3937-df31-48e2-b239-e3af60711cbe req-95442760-5074-4963-b388-4005e49d7dbd service nova] Creating event network-vif-deleted:edce147b-e88b-4b4e-9723-100efdf1322f for instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 on hv-cinder-84457 Jun 03 12:04:16.268981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-269a3937-df31-48e2-b239-e3af60711cbe req-95442760-5074-4963-b388-4005e49d7dbd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Jun 03 12:04:16.270799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 273/542] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:16.638545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:16.639149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:16.645042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:16.645672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:16.646421 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:16.647117 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:16.678662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:16.679106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:16.679570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'fault' on Instance uuid 187129e0-f035-4b58-b3ff-7a6bb94ed536 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:04:16.682315 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:16.747418 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:16.757769 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-14920700-768a-47ac-ae45-463472642dcb tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 200 len: 1335 microversion: 2.1 time: 0.123362 Jun 03 12:04:16.768690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 270/543] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:16 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:17.229908 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:17.230516 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:17.237042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:17.237491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:17.238258 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:17.238693 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:17.370940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:17.378617 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-22f8d1a1-0b70-4c92-bd08-e564c1e1c261 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.153444 Jun 03 12:04:17.379179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 274/544] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:17 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:17.776380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:17.776995 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 187129e0-f035-4b58-b3ff-7a6bb94ed536] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:17.783483 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:17.783972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:17.784736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:17.785176 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:17.798250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] HTTP exception thrown: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 could not be found. Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Request method failure captured: Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 HTTP/1.1 Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfduedHNt1m7wblLZ9kOTIzLGXSMupGli3zb3RkbS-guY0WE5PnKCpv-w_uck9rKeOOuChQzR99EbSnYRFXFztFcVb3535efxUgctS-SzVU9VaBjG1MiQbh9c-zhMuUaCD-hv8WFiLT8tIego4vD4IoGmr9TgGeB3X-Ykx1ugCRw1Tc Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:04:17.799898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_799fb68a55084528ab5573051a1bf121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/799fb68a55084528ab5573051a1bf121"}]}] Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: abcc58cb66804297b184e41726c281bb Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 could not be found. Jun 03 12:04:17.801997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '187129e0-f035-4b58-b3ff-7a6bb94ed536'} Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 could not be found. Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:04:17.802809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 could not be found. Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 could not be found. Jun 03 12:04:17.804380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:17.806275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Returning 404 to user: Instance 187129e0-f035-4b58-b3ff-7a6bb94ed536 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:04:17.806275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2f129dee-ef7a-445a-8824-41220a3b2433 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536" status: 404 len: 111 microversion: 2.1 time: 0.028962 Jun 03 12:04:17.806275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 271/545] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:17 2022] GET /compute/v2.1/servers/187129e0-f035-4b58-b3ff-7a6bb94ed536 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:04:17.810392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6ced6ac7-ad27-41ef-bcd6-59378649e566 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '.version_select at 0x7f19c5b6f790>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:17.826955 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6ced6ac7-ad27-41ef-bcd6-59378649e566 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636258561" status: 202 len: 0 microversion: 2.1 time: 0.020339 Jun 03 12:04:17.827488 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 275/546] 10.222.0.15 () {58 vars in 1217 bytes} [Fri Jun 3 12:04:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636258561 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:04:18.396347 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:18.397257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:18.400381 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:18.404065 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:18.404562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:18.405341 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:18.405967 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:18.545530 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:18.553075 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6780c3ed-bf98-4db9-a2a6-e667f8a84050 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.160701 Jun 03 12:04:18.553650 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 272/547] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:18 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:19.570828 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:19.571442 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:19.573517 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:19.579309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:19.579802 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:19.580928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:19.581363 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:19.717737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:19.725776 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-43952a71-8e35-4b08-b3b5-ec2eb395e208 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.160126 Jun 03 12:04:19.726331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 276/548] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:19 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:20.654058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:20.654559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:20.661104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:20.661703 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:20.662753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:20.663388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:20.688710 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:04:20.743154 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:20.743870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:20.750119 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:20.750659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:20.751410 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:20.751875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:20.766309 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c70b9a4c-da56-4d6b-8d98-2aa049d5bd12 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "DELETE /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 204 len: 0 microversion: 2.1 time: 0.115736 Jun 03 12:04:20.767326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 273/549] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:04:20 2022] DELETE /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:04:20.775992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:20.776680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:20.782546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:20.782996 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:20.783787 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:20.784223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:20.926413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:20.934819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-54fbaaba-b9cf-4ae7-ac60-9dadb2119035 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1506 microversion: 2.1 time: 0.163532 Jun 03 12:04:20.935388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 274/550] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:20 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:21.087002 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:21.094402 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-34bed8f9-0543-4311-bef9-f839069ac6b3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.355544 Jun 03 12:04:21.094953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 277/551] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:20 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:21.952897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:21.953532 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:21.960137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:21.960581 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:21.961325 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:21.961754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:22.088706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:22.096159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7cac7ab0-512a-4a92-a7b5-057b3476e921 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1506 microversion: 2.1 time: 0.147252 Jun 03 12:04:22.096721 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 275/552] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:21 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:22.111232 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:22.111871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:22.118275 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:22.118721 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:22.119469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:22.119946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:22.137607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:22.247240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:22.254597 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2e61de0e-38b5-43f7-a21f-62470230b464 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.147126 Jun 03 12:04:22.255214 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 278/553] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:22 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:23.112866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:23.113467 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:23.119902 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:23.120345 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:23.121589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:23.122336 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:23.252312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:23.259589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2b22e9f8-755b-4932-818a-4bdfd7fae0f9 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1506 microversion: 2.1 time: 0.150509 Jun 03 12:04:23.260143 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 276/554] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:23 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:23.272644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:23.273289 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:23.279775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:23.280220 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:23.280971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:23.281403 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:23.413877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:23.421257 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1c598942-2715-4f98-8060-ddb4c08f25e2 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.153177 Jun 03 12:04:23.421813 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 279/555] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:23 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:24.189295 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-529ca7f0-f0f3-4358-8063-de471a683221 req-b7cfa652-0640-4e91-b17f-206df36f0f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773c52dc-848f-4fe8-bb42-02d7bce02898", "name": "network-vif-deleted", "tag": "d2f7adff-2e38-430b-9551-404dd7ca8229"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:24.198124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-529ca7f0-f0f3-4358-8063-de471a683221 req-b7cfa652-0640-4e91-b17f-206df36f0f13 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:24.198572 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-529ca7f0-f0f3-4358-8063-de471a683221 req-b7cfa652-0640-4e91-b17f-206df36f0f13 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:24.209682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-529ca7f0-f0f3-4358-8063-de471a683221 req-b7cfa652-0640-4e91-b17f-206df36f0f13 service nova] Creating event network-vif-deleted:d2f7adff-2e38-430b-9551-404dd7ca8229 for instance 773c52dc-848f-4fe8-bb42-02d7bce02898 on hv-cinder-84457 Jun 03 12:04:24.215319 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-529ca7f0-f0f3-4358-8063-de471a683221 req-b7cfa652-0640-4e91-b17f-206df36f0f13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029598 Jun 03 12:04:24.216180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 277/556] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:24.276996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:24.277580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:24.284259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:24.284763 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:24.285459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:24.285881 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:24.320261 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:24.320700 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:24.321144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'fault' on Instance uuid 773c52dc-848f-4fe8-bb42-02d7bce02898 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:04:24.361433 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:24.369478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9ad2d2cc-5b23-467e-8376-9b229e2897e1 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 200 len: 1311 microversion: 2.1 time: 0.096313 Jun 03 12:04:24.370026 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 280/557] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:24 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:24.438414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:24.439048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:24.445201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:24.445645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:24.446434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:24.446866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:24.586823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:24.594553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b14fd010-d500-4ffe-b97e-ae2517a54aed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.160290 Jun 03 12:04:24.595348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 278/558] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:24 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:25.387243 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:25.387872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: 773c52dc-848f-4fe8-bb42-02d7bce02898] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:25.394513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.394953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.395740 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.396169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.409704 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] HTTP exception thrown: Instance 773c52dc-848f-4fe8-bb42-02d7bce02898 could not be found. Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Request method failure captured: Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 HTTP/1.1 Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfduedHNt1m7wblLZ9kOTIzLGXSMupGli3zb3RkbS-guY0WE5PnKCpv-w_uck9rKeOOuChQzR99EbSnYRFXFztFcVb3535efxUgctS-SzVU9VaBjG1MiQbh9c-zhMuUaCD-hv8WFiLT8tIego4vD4IoGmr9TgGeB3X-Ykx1ugCRw1Tc Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:04:25.411305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_799fb68a55084528ab5573051a1bf121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/799fb68a55084528ab5573051a1bf121"}]}] Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: abcc58cb66804297b184e41726c281bb Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 773c52dc-848f-4fe8-bb42-02d7bce02898 could not be found. Jun 03 12:04:25.412830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '773c52dc-848f-4fe8-bb42-02d7bce02898'} Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 773c52dc-848f-4fe8-bb42-02d7bce02898 could not be found. Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:04:25.413724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 773c52dc-848f-4fe8-bb42-02d7bce02898 could not be found. Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 773c52dc-848f-4fe8-bb42-02d7bce02898 could not be found. Jun 03 12:04:25.415191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:04:25.416541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Returning 404 to user: Instance 773c52dc-848f-4fe8-bb42-02d7bce02898 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:04:25.416541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-55ff09dd-5b64-41df-ba5c-83fb6325b3c6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898" status: 404 len: 111 microversion: 2.1 time: 0.029301 Jun 03 12:04:25.416541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 281/559] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:25 2022] GET /compute/v2.1/servers/773c52dc-848f-4fe8-bb42-02d7bce02898 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:04:25.421063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:25.421565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:25.428543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.428992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.429751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.430191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.454697 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:04:25.525483 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-11598145-0346-463a-b250-606297a2f0f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 204 len: 0 microversion: 2.1 time: 0.107959 Jun 03 12:04:25.526163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 279/560] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:04:25 2022] DELETE /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:04:25.535341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:25.535970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:25.542388 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.542826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.543636 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.544114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.612031 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:25.612859 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:25.619812 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.619918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.620695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:25.621130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:25.674008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:25.682172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ad4bb2d9-dc5d-42a1-bdb0-e4a886be2cfe tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.151966 Jun 03 12:04:25.682732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 282/561] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:25 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:25.752438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:25.760026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3ced577e-6c7a-4915-91b4-e51487f779b6 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.152310 Jun 03 12:04:25.760590 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 280/562] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:25 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:26.699034 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:26.699689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:26.705978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:26.706420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:26.707185 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:26.707616 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:26.780127 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:26.780923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:26.788383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:26.789043 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:26.790424 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:26.791537 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:26.838514 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:26.846336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bedcd7fe-c0f1-4e84-8425-31975396bbd6 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.150858 Jun 03 12:04:26.847106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 283/563] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:26 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:26.935756 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:26.943841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e42454c4-3a8e-43a5-b576-9b0d3fbf57fd tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.169255 Jun 03 12:04:26.944396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 281/564] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:26 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:27.863232 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:27.863855 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:27.870249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:27.870684 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:27.871421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:27.871868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:27.960152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:27.960759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:27.967034 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:27.967472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:27.968245 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:27.968710 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:27.998179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:28.006305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0460e9bc-25f4-4827-beaa-4ae5dbac32d2 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1521 microversion: 2.1 time: 0.146896 Jun 03 12:04:28.006873 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 284/565] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:27 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:28.098357 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:28.105900 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e037c90a-5f30-4d92-aa55-a2363e1d7bc3 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.150192 Jun 03 12:04:28.106459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 282/566] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:27 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:28.766750 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-de218323-e85e-4fa1-bf37-da7bab0b80e0 req-c3ebafd7-9b35-4f0e-a678-2259bc5258ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7dbfbf-015e-447d-96cd-5ab9efa88d62", "name": "network-vif-deleted", "tag": "def82060-451f-48f0-9d78-a33f82670dc7"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:28.769913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-f8b33a35-5564-4129-a788-d9ab32010a61 req-f8243cc2-228c-4e1d-b4cc-f603bdbf9738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "name": "network-vif-plugged", "status": "completed", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:28.778555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-de218323-e85e-4fa1-bf37-da7bab0b80e0 req-c3ebafd7-9b35-4f0e-a678-2259bc5258ef service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:28.779348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-de218323-e85e-4fa1-bf37-da7bab0b80e0 req-c3ebafd7-9b35-4f0e-a678-2259bc5258ef service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:28.785340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-f8b33a35-5564-4129-a788-d9ab32010a61 req-f8243cc2-228c-4e1d-b4cc-f603bdbf9738 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:28.785867 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-f8b33a35-5564-4129-a788-d9ab32010a61 req-f8243cc2-228c-4e1d-b4cc-f603bdbf9738 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:28.802983 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-f8b33a35-5564-4129-a788-d9ab32010a61 req-f8243cc2-228c-4e1d-b4cc-f603bdbf9738 service nova] Creating event network-vif-plugged:433e2f7b-47d6-4109-8c8b-a4880b50eadb for instance df0736cf-da48-4947-8e88-687dd441a9c2 on hv-cinder-84457 Jun 03 12:04:28.808732 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-f8b33a35-5564-4129-a788-d9ab32010a61 req-f8243cc2-228c-4e1d-b4cc-f603bdbf9738 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043549 Jun 03 12:04:28.809450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 283/567] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:04:28.811559 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-de218323-e85e-4fa1-bf37-da7bab0b80e0 req-c3ebafd7-9b35-4f0e-a678-2259bc5258ef service nova] Creating event network-vif-deleted:def82060-451f-48f0-9d78-a33f82670dc7 for instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 on hv-cinder-84457 Jun 03 12:04:28.817919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-de218323-e85e-4fa1-bf37-da7bab0b80e0 req-c3ebafd7-9b35-4f0e-a678-2259bc5258ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054501 Jun 03 12:04:28.818727 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 285/568] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:29.024307 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:29.024960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:29.031088 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:29.031714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:29.032507 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:29.032948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:29.063553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:29.064008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:29.064470 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lazy-loading 'fault' on Instance uuid cb7dbfbf-015e-447d-96cd-5ab9efa88d62 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:04:29.109876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcc58cb66804297b184e41726c281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb68a55084528ab5573051a1bf121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:29.117447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-886d4ff1-0828-4228-8167-6991c9a0045f tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 200 len: 1312 microversion: 2.1 time: 0.098987 Jun 03 12:04:29.118010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 284/569] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:29 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:29.122566 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:29.123262 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:29.130179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:29.130561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:29.131479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:29.131934 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:29.266722 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:29.275202 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bab30130-4eb0-4fb3-a9f4-d9154a28319f tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.156863 Jun 03 12:04:29.275811 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 286/570] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:29 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:30.134082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:30.134690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] [instance: cb7dbfbf-015e-447d-96cd-5ab9efa88d62] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:30.141254 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:30.141690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:30.142439 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:30.142874 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:30.156077 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] HTTP exception thrown: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 could not be found. Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Request method failure captured: Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 HTTP/1.1 Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfduedHNt1m7wblLZ9kOTIzLGXSMupGli3zb3RkbS-guY0WE5PnKCpv-w_uck9rKeOOuChQzR99EbSnYRFXFztFcVb3535efxUgctS-SzVU9VaBjG1MiQbh9c-zhMuUaCD-hv8WFiLT8tIego4vD4IoGmr9TgGeB3X-Ykx1ugCRw1Tc Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:04:30.157614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_799fb68a55084528ab5573051a1bf121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/799fb68a55084528ab5573051a1bf121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/799fb68a55084528ab5573051a1bf121"}]}] Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 799fb68a55084528ab5573051a1bf121 Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-596414485 Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: abcc58cb66804297b184e41726c281bb Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-596414485-project Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 could not be found. Jun 03 12:04:30.159154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'cb7dbfbf-015e-447d-96cd-5ab9efa88d62'} Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 could not be found. Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:04:30.160189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 could not be found. Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 could not be found. Jun 03 12:04:30.162123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:04:30.163536 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] Returning 404 to user: Instance cb7dbfbf-015e-447d-96cd-5ab9efa88d62 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:04:30.163536 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f28749bf-247e-4194-81dd-108f546480f7 tempest-ServerRescueNegativeTestJSON-596414485 tempest-ServerRescueNegativeTestJSON-596414485-project] 10.222.0.15 "GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62" status: 404 len: 111 microversion: 2.1 time: 0.028815 Jun 03 12:04:30.163536 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 285/571] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:30 2022] GET /compute/v2.1/servers/cb7dbfbf-015e-447d-96cd-5ab9efa88d62 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:04:30.291900 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:30.292499 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:30.298998 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:30.299437 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:30.300216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:30.300644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:30.512962 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:30.520379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5002f12b-295d-40c0-8882-54df2c919ef5 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1575 microversion: 2.1 time: 0.232260 Jun 03 12:04:30.522043 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 287/572] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:30 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:31.538497 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:31.539193 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:31.545885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:31.546352 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:31.547086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:31.547539 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:31.551637 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:31.679322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:31.686850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8bd2f79e-7986-4153-abb9-b2e1c55773ed tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1562 microversion: 2.1 time: 0.152725 Jun 03 12:04:31.687413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 286/573] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:31 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:38.779459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-452fbd90-47d5-4276-a909-045e5018349f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: .version_select at 0x7f19c5be4b80>, body: {"keypair": {"name": "tempest-keypair-1185905067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQPY65PEomyFl5+lWyVdOkJOoLr1ZfVkhSAzgMNTesTzC7glJMjHxhJu9jfhXXcdTJEKoAWDLC5/LeEDXwo4Ecm76WQ8zhqhp9Dc/pkECG9IyALMAcXkk0RDJbQv4uFjw=="}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:38.793918 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-452fbd90-47d5-4276-a909-045e5018349f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for project db41a74c9582485b9def49d558170121. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:04:38.797967 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-452fbd90-47d5-4276-a909-045e5018349f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for user 76db57106a684c7592dc8cba4bc0a9d7 and project db41a74c9582485b9def49d558170121. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:04:38.823193 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-452fbd90-47d5-4276-a909-045e5018349f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187489 Jun 03 12:04:38.823887 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 288/574] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:04:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:40.099222 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1497477146", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03361f06-4300-4076-a569-cdce901f3442"}], "security_groups": [{"name": "tempest-securitygroup--1002597324"}], "key_name": "tempest-keypair-1185905067", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:40.206383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] validate_networks() for [('03361f06-4300-4076-a569-cdce901f3442', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:04:40.819471 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:04:40.819926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:04:40.820394 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:04:40.820796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:04:40.821202 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:04:40.829757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:40.830200 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:40.830981 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:40.831409 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:40.848224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for project db41a74c9582485b9def49d558170121. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:04:40.852693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for user 76db57106a684c7592dc8cba4bc0a9d7 and project db41a74c9582485b9def49d558170121. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:04:40.863596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:04:40.866414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:04:40.918664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-11ae7d70-e08b-4fa1-a589-92fc075c3d55 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.823988 Jun 03 12:04:40.921547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 287/575] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:04:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:04:40.929892 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b05ced3c-8ecf-4a24-ba44-46fb2ea17680 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:40.931038 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b05ced3c-8ecf-4a24-ba44-46fb2ea17680 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:40.934254 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=50 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:40.996283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b05ced3c-8ecf-4a24-ba44-46fb2ea17680 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:41.004653 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b05ced3c-8ecf-4a24-ba44-46fb2ea17680 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1238 microversion: 2.1 time: 0.078503 Jun 03 12:04:41.006088 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 289/576] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:40 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:42.022850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:42.024337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:42.031107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:42.031630 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:42.032461 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:42.032905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:42.121672 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:42.129607 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-279287e9-b26f-4e81-8f24-c339f056dd24 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1308 microversion: 2.1 time: 0.111168 Jun 03 12:04:42.130268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 288/577] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:42 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:43.146939 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:43.147791 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:43.156148 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:43.156615 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:43.157405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:43.158157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:43.303032 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:43.311732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f8dd4b2f-3391-4c01-9205-82a6fc48aa80 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.169355 Jun 03 12:04:43.312431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 290/578] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:43 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:43.440071 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-5cf80a44-b137-4ee4-9ecb-ed2a6d27d942 req-63300f1d-e4da-4aa7-b172-5bc6c0fdae06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dd2271-e4e4-4e18-b2e4-69993351fdfb", "tag": "ea2d2af1-a2e2-4462-b153-e3177e0b7809"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:43.451173 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5cf80a44-b137-4ee4-9ecb-ed2a6d27d942 req-63300f1d-e4da-4aa7-b172-5bc6c0fdae06 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:43.452058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5cf80a44-b137-4ee4-9ecb-ed2a6d27d942 req-63300f1d-e4da-4aa7-b172-5bc6c0fdae06 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:43.480494 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-5cf80a44-b137-4ee4-9ecb-ed2a6d27d942 req-63300f1d-e4da-4aa7-b172-5bc6c0fdae06 service nova] Creating event network-changed:ea2d2af1-a2e2-4462-b153-e3177e0b7809 for instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb on hv-cinder-84457 Jun 03 12:04:43.486411 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-5cf80a44-b137-4ee4-9ecb-ed2a6d27d942 req-63300f1d-e4da-4aa7-b172-5bc6c0fdae06 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049270 Jun 03 12:04:43.487021 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 289/579] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:44.328978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:44.329621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:44.336133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:44.336581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:44.337338 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:44.337772 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:44.462180 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:44.469642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-afc6bc7b-1936-47fc-bdbd-642efe3f1f4e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.144465 Jun 03 12:04:44.470202 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 291/580] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:44 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:45.486574 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:45.487271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:45.494450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:45.494924 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:45.495712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:45.496154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:45.626575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:45.634546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3a354c4e-13a4-4906-8821-e804e2c9296c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.152151 Jun 03 12:04:45.635098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 290/581] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:45 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:46.651444 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:46.652079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:46.658390 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:46.658829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:46.659602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:46.660033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:46.793107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:46.800581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-21acac6e-3284-4219-824a-f9dc67b0101d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.152957 Jun 03 12:04:46.801153 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 292/582] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:46 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:47.818459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:47.819061 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:47.825596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:47.826069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:47.826810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:47.827239 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:47.953806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:47.961219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0fac58ff-2a6a-4e12-bbb2-63ced0d1d982 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.147222 Jun 03 12:04:47.961774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 291/583] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:47 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:48.961191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-03c7137f-08e0-45e5-a5aa-0693edf4bd55 req-1ade5b4f-83cf-49ae-a4c6-a398909baa15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dd2271-e4e4-4e18-b2e4-69993351fdfb", "name": "network-vif-plugged", "status": "completed", "tag": "ea2d2af1-a2e2-4462-b153-e3177e0b7809"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:48.969932 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-03c7137f-08e0-45e5-a5aa-0693edf4bd55 req-1ade5b4f-83cf-49ae-a4c6-a398909baa15 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:48.970462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-03c7137f-08e0-45e5-a5aa-0693edf4bd55 req-1ade5b4f-83cf-49ae-a4c6-a398909baa15 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:48.979321 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:48.980612 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:48.982350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-03c7137f-08e0-45e5-a5aa-0693edf4bd55 req-1ade5b4f-83cf-49ae-a4c6-a398909baa15 service nova] Creating event network-vif-plugged:ea2d2af1-a2e2-4462-b153-e3177e0b7809 for instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb on hv-cinder-84457 Jun 03 12:04:48.986544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:48.987294 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-03c7137f-08e0-45e5-a5aa-0693edf4bd55 req-1ade5b4f-83cf-49ae-a4c6-a398909baa15 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030314 Jun 03 12:04:48.988238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 293/584] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:48.989510 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:48.989972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:48.990758 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:48.991196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:49.128974 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:49.136856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-84b773cb-4547-4d47-b712-341f3319f5e2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.161537 Jun 03 12:04:49.137478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 292/585] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:48 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:04:50.154799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:50.155431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:50.157351 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:50.164028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:50.164466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:50.165215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:50.165640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:50.294309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:50.301728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f0f90331-24ed-4069-8743-97c63b3e4ab1 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1364 microversion: 2.1 time: 0.151588 Jun 03 12:04:50.302281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 294/586] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:50 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:51.318980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:51.319680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:51.321636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:51.322249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:51.328001 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:51.328415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:51.329172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:51.329605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:51.458757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:04:51.466152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf535df6-8fb7-447c-a9a4-82d3dced3b73 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1550 microversion: 2.1 time: 0.151530 Jun 03 12:04:51.466714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 293/587] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:04:51 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:04:51.482412 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:04:51.482903 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:04:51.484760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:51.491179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:51.491669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:51.492427 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:51.492862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:51.569032 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f65897ff-30c5-4434-b423-07a241dee671 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090330 Jun 03 12:04:51.569618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 295/588] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:04:51 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:04:52.504956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-247cf086-6f82-477b-89ea-ce13c4101ce4 req-1e2109e2-d5b1-4df3-8df9-91b4bf26ef81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dd2271-e4e4-4e18-b2e4-69993351fdfb", "tag": "ea2d2af1-a2e2-4462-b153-e3177e0b7809"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:04:52.512890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-247cf086-6f82-477b-89ea-ce13c4101ce4 req-1e2109e2-d5b1-4df3-8df9-91b4bf26ef81 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:04:52.513334 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-247cf086-6f82-477b-89ea-ce13c4101ce4 req-1e2109e2-d5b1-4df3-8df9-91b4bf26ef81 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:04:52.524891 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-247cf086-6f82-477b-89ea-ce13c4101ce4 req-1e2109e2-d5b1-4df3-8df9-91b4bf26ef81 service nova] Creating event network-changed:ea2d2af1-a2e2-4462-b153-e3177e0b7809 for instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb on hv-cinder-84457 Jun 03 12:04:52.529930 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-247cf086-6f82-477b-89ea-ce13c4101ce4 req-1e2109e2-d5b1-4df3-8df9-91b4bf26ef81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086332 Jun 03 12:04:52.530620 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 294/589] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:05:27.709102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:27.709900 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=30 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:27.714212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:27.714699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:27.721564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:27.722051 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:27.723353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:27.723814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:27.746019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bcb0ef36-d852-4421-8b49-d4d30ce6abca tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/ips" status: 200 len: 152 microversion: 2.20 time: 0.038287 Jun 03 12:05:27.746580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 296/590] 10.222.0.15 () {60 vars in 1288 bytes} [Fri Jun 3 12:05:27 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:05:29.537641 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=5 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:29.538384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=40 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:29.542866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:05:29.543560 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:29.551082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:29.551553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:29.552315 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:29.552749 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:29.574288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lazy-loading 'flavor' on Instance uuid 2694de28-e6b8-4a9c-b13b-74192112056c {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:05:29.827620 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-52b263b9-6dbb-4c24-a3ce-a0c6d2ad5d33 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/action" status: 202 len: 0 microversion: 2.20 time: 0.291430 Jun 03 12:05:29.828359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 295/591] 10.222.0.15 () {62 vars in 1318 bytes} [Fri Jun 3 12:05:29 2022] POST /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:05:29.836722 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:29.837348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:29.846333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:29.846872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:29.847860 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:29.848303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:30.015066 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:30.023694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:30.025188 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:30.026333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5e33c035-408a-432a-9798-40e1c98c57bd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.193813 Jun 03 12:05:30.026886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 297/592] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:29 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:31.046496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:31.053351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:31.055457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:31.055947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:31.056689 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:31.057117 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:31.200143 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:31.207960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:31.209449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:31.210596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f12a825a-3a32-4ea9-bbea-b1ec65009375 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.169046 Jun 03 12:05:31.211138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 296/593] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:31 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:32.229261 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:32.229816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:32.236430 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:32.236871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:32.237675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:32.238127 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:32.364299 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:32.372081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:32.373576 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:32.374722 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5e27104f-0f95-462b-999f-87d492475b25 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.149424 Jun 03 12:05:32.375275 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 298/594] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:32 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:33.393139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:33.394248 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:33.401032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:33.401475 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:33.402231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:33.402668 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:33.530210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:33.538799 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:33.540321 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:33.541479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-71eb6793-3ea2-4d0b-a435-619ac2aeab5f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.152293 Jun 03 12:05:33.542243 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 297/595] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:33 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:34.560037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:34.560674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:34.567820 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:34.568259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:34.569020 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:34.569450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:34.703212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:34.712233 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:34.713735 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:34.714895 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a575b56b-f127-4526-94d4-dc11cfb89039 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.158790 Jun 03 12:05:34.715460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 299/596] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:34 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:35.732366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:35.732985 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:35.740265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:35.740745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:35.741519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:35.741964 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:35.875744 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:35.884237 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:35.885739 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:35.886894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-284f529e-b91f-4870-9d65-30ce77061ff2 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.158425 Jun 03 12:05:35.887455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 298/597] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:35 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:36.905281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:36.905937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:36.912436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:36.912880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:36.913641 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:36.914075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:37.044408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:37.056690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:37.060007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:37.062283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-163557f9-8e5b-4773-b5c4-c272ab3c6f4f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.160504 Jun 03 12:05:37.063369 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 300/598] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:36 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:38.080442 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:38.081132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:38.087645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:38.088089 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:38.088848 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:38.089287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:38.222861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:38.230935 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:38.232662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:38.233820 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b6bc7b1c-2449-4b3b-bb44-88ecc10cd00a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.157330 Jun 03 12:05:38.234374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 299/599] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:38 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:39.254381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:39.255041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:39.261534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:39.261980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:39.262741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:39.263169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:39.401777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:39.409639 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:39.411126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:39.412300 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-778b1311-5648-4417-baa0-3758bfe09037 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.162381 Jun 03 12:05:39.412854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 301/600] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:39 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:40.431054 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:40.431637 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:40.438402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:40.438859 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:40.439660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:40.440101 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:40.568297 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:40.576165 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:40.577675 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:40.578828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-36dc4109-0352-40d2-b935-62eeb87f1e0f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.151923 Jun 03 12:05:40.579382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 300/601] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:40 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:41.597584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:41.598181 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:41.604733 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:41.605173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:41.605910 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:41.606334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:41.753684 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:41.762804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:41.764330 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:41.765480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-61b4d01f-a401-492f-abd9-4bc1ecf24532 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.172294 Jun 03 12:05:41.766034 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 302/602] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:41 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:42.785468 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:42.786058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:42.792575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:42.793027 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:42.793780 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:42.794215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:42.925196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:42.933000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:42.934489 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:42.935669 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-27eb4151-15bc-4a60-81fc-073b936f3526 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.154891 Jun 03 12:05:42.936220 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 301/603] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:42 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:43.953504 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:43.954107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:43.960535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:43.960976 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:43.961723 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:43.962150 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:44.092614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:44.100499 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:44.102023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:44.103164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-af16162b-1c3a-43f8-a639-6e268a178a74 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.153563 Jun 03 12:05:44.103751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 303/604] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:43 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:45.121573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:45.122175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:45.128679 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:45.129125 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:45.129872 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:45.130300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:45.260836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:45.268709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:45.270198 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:45.271334 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5e365d1a-4903-4983-9408-ed796e380aa7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.153666 Jun 03 12:05:45.272270 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 302/605] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:45 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:46.290624 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:46.291341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:46.297839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:46.298280 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:46.299037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:46.299491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:46.462311 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:46.470248 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:46.472395 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:46.473538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-deae88ec-9040-4d3a-8a0f-e8d5b53d46f9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1746 microversion: 2.20 time: 0.187217 Jun 03 12:05:46.474090 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 304/606] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:46 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1746 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:05:47.492402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:47.492960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:47.499763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:47.500240 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:47.501009 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:47.501465 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:47.648549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:47.656587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:47.658102 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:47.659327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ed6dec8b-e2b5-433e-aa81-3ad833dd40b7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1746 microversion: 2.20 time: 0.171086 Jun 03 12:05:47.659918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 303/607] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:47 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:48.678301 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:48.678971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:48.686573 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:48.686927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:48.687797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:48.688322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:48.857209 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:48.866225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:48.867770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:48.868970 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1e6b927f-2278-4c6f-96c0-1cf8aaaf563d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1746 microversion: 2.20 time: 0.195373 Jun 03 12:05:48.869542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 305/608] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:48 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1746 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:49.888126 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:49.888738 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:49.896002 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:49.896706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:49.897469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:49.897901 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:50.026348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:50.034748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:50.036268 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:50.037415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-834e06a5-b84a-48de-883d-951a9b54ac6d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1746 microversion: 2.20 time: 0.153196 Jun 03 12:05:50.037958 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 304/609] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:49 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:51.055389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:51.056021 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:51.062804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:51.063246 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:51.064040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:51.064460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:51.151720 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-420e5c88-9116-4b46-aa59-58834b473a81 req-2c42a654-59a7-4316-921d-88d20faff839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "name": "network-vif-plugged", "status": "completed", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:05:51.161981 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-420e5c88-9116-4b46-aa59-58834b473a81 req-2c42a654-59a7-4316-921d-88d20faff839 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:51.163263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-420e5c88-9116-4b46-aa59-58834b473a81 req-2c42a654-59a7-4316-921d-88d20faff839 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:51.179224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-420e5c88-9116-4b46-aa59-58834b473a81 req-2c42a654-59a7-4316-921d-88d20faff839 service nova] Creating event network-vif-plugged:92dddd28-a98f-47bd-a228-483608919ed6 for instance 2694de28-e6b8-4a9c-b13b-74192112056c on hv-cinder-84457 Jun 03 12:05:51.185543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-420e5c88-9116-4b46-aa59-58834b473a81 req-2c42a654-59a7-4316-921d-88d20faff839 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039933 Jun 03 12:05:51.186362 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 305/610] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:05:51.207685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:51.215658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:51.217872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:51.219270 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9d982cd1-9647-4f2b-884c-ee94a5770975 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1746 microversion: 2.20 time: 0.167999 Jun 03 12:05:51.219869 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 306/611] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:51 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:52.239763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:52.240616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:52.247640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:52.248087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:52.248943 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:52.249379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:52.385781 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:52.393892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:52.395392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:52.396862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e8c6ed80-e7c3-4c30-ae19-042850a61863 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.162594 Jun 03 12:05:52.397414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 306/612] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:52 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:53.415041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:53.415796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:53.422537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:53.423241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:53.424244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:53.424830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:53.578998 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:53.588205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:53.589691 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:53.590829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1dec32bb-ef9e-4e0d-b88a-de34577cccaf tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.179750 Jun 03 12:05:53.591383 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 307/613] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:53 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:54.612248 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:54.613546 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:54.621940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:54.622478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:54.623249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:54.623704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:54.768570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:54.778046 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:54.779718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:54.781541 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-feb7ed2a-7ca5-486f-88d7-ede465e22869 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.173555 Jun 03 12:05:54.782302 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 307/614] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:54 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:55.801931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:55.802537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:55.809334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:55.809939 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:55.810781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:55.811552 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:56.201405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:56.210210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:56.212192 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:56.213348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e4682388-8128-4480-8c92-ce2045769817 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.416169 Jun 03 12:05:56.213896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 308/615] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:55 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:57.233468 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:57.234154 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:57.240799 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:57.241263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:57.242022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:57.242461 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:57.391005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:57.400423 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:57.401970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:57.403259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3925c741-895c-4490-a854-f5c6c6140ecc tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.173987 Jun 03 12:05:57.403851 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 308/616] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:57 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:58.422601 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:58.424801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:58.427806 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=27 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:58.434119 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:58.434583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:58.435568 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:58.436113 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:58.439836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=77 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:58.627960 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:58.647157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:58.659919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:58.661210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-06fe4d75-6521-435d-9ec6-d236bfc0ec4d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.243291 Jun 03 12:05:58.661781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 309/617] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:58 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:05:59.687274 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:05:59.688263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:05:59.694485 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=29 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:59.702498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:59.703312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:59.704317 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:05:59.704776 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:05:59.710651 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:59.883550 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:59.898022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:59.900163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:05:59.901778 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6f418984-4335-4f01-89dc-e4d2d7326252 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.221672 Jun 03 12:05:59.912711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 309/618] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:05:59 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:00.925076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:00.926314 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:00.934627 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:00.935076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:00.935880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:00.936307 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:01.106781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:01.120964 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:01.122577 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:01.123948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0f8818a7-81f7-499d-aa68-04eafea7a518 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.206228 Jun 03 12:06:01.124677 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 310/619] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:00 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:02.141624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:02.142234 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:02.149162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:02.149611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:02.150538 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:02.150840 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:02.279144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:02.287534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:02.289022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:02.290166 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fce69494-d445-48e8-ab7d-75c6bbd08faa tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1741 microversion: 2.20 time: 0.152472 Jun 03 12:06:02.290711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 310/620] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:02 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:03.309211 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:03.309805 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:03.316822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:03.317260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:03.318020 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:03.318447 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:03.448271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:03.456079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:03.457550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:03.458702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ef31dfb1-85d5-4c60-9077-fc4427b637ba tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1723 microversion: 2.20 time: 0.153443 Jun 03 12:06:03.459232 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 311/621] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:03 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:04.477251 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:04.477832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:04.484340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:04.484782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:04.485543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:04.485971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:04.615885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:04.623706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:04.625195 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:04.626599 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-38b8653a-2ffb-4075-9087-e77289b1138a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1723 microversion: 2.20 time: 0.153043 Jun 03 12:06:04.627219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 311/622] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:04 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:05.167009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-4d7dc1c3-f879-4172-ad9c-a334c0c34cc4 req-0cdec963-dd6e-49b0-9957-e975bd19b493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "name": "network-vif-unplugged", "status": "completed", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:05.176442 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-4d7dc1c3-f879-4172-ad9c-a334c0c34cc4 req-0cdec963-dd6e-49b0-9957-e975bd19b493 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:05.176896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-4d7dc1c3-f879-4172-ad9c-a334c0c34cc4 req-0cdec963-dd6e-49b0-9957-e975bd19b493 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:05.188231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.compute.server_external_events [req-4d7dc1c3-f879-4172-ad9c-a334c0c34cc4 req-0cdec963-dd6e-49b0-9957-e975bd19b493 service nova] Unable to find a host for instance 2694de28-e6b8-4a9c-b13b-74192112056c. Dropping event network-vif-unplugged {{(pid=117617) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 12:06:05.189093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-4d7dc1c3-f879-4172-ad9c-a334c0c34cc4 req-0cdec963-dd6e-49b0-9957-e975bd19b493 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025917 Jun 03 12:06:05.190292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 312/623] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 12:06:05.647100 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:05.647766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:05.654183 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:05.654627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:05.655387 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:05.655848 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:05.792765 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:05.801401 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:05.802894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:05.804090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-890e4492-de1f-4cad-95ce-05654bf52af4 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1666 microversion: 2.20 time: 0.161774 Jun 03 12:06:05.804646 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 312/624] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:05 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:05.823241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce86d0c8-cd9d-4415-820f-2c25f7363602"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:05.824346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:05.831132 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:05.831618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:05.832394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:05.832826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:06.096024 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f642c2f8-9f0f-4920-8321-45efbd779452 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276488 Jun 03 12:06:06.096653 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 313/625] 10.222.0.15 () {62 vars in 1363 bytes} [Fri Jun 3 12:06:05 2022] POST /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:06:06.216146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:06.216636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:06.223388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:06.223833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:06.224600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:06.225029 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:06.641224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-56722d30-d575-4af4-84c8-bcaf9480ed5a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-volume_attachments/ce86d0c8-cd9d-4415-820f-2c25f7363602" status: 202 len: 0 microversion: 2.20 time: 0.430988 Jun 03 12:06:06.642007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 313/626] 10.222.0.15 () {60 vars in 1456 bytes} [Fri Jun 3 12:06:06 2022] DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-volume_attachments/ce86d0c8-cd9d-4415-820f-2c25f7363602 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:06:06.700129 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:06.700775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:06.707984 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:06.708426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:06.709173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:06.709603 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:06.854633 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-51edd6a2-d2a1-4a2e-ba6c-f4187d479e6e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "POST /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/action" status: 202 len: 0 microversion: 2.20 time: 0.158487 Jun 03 12:06:06.855225 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 314/627] 10.222.0.15 () {62 vars in 1318 bytes} [Fri Jun 3 12:06:06 2022] POST /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:06:06.864136 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:06.864733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:06.871482 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:06.871963 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:06.872766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:06.873398 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:07.008100 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:07.015890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:07.017383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:07.018538 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5bcc9ceb-cb95-454f-84e2-32f0ae098c71 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1674 microversion: 2.20 time: 0.159064 Jun 03 12:06:07.019095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 314/628] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:06 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:07.420229 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:07.420844 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:07.427298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:07.427778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:07.428522 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:07.428951 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:07.452228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-58cd8f2c-28c6-445d-9742-dcf2c8a193b4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/ips" status: 200 len: 145 microversion: 2.1 time: 0.035885 Jun 03 12:06:07.452793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 315/629] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:06:07 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:06:08.036911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:08.037540 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:08.044730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:08.045173 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:08.046110 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:08.046542 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:08.449568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:08.457779 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:08.459534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:08.460870 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b6509961-801d-4d89-9e4a-63634799f690 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.427919 Jun 03 12:06:08.461419 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 315/630] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:08 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:09.016046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:09.020113 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:09.020923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-a56fe55f-7c32-49f5-87d1-27daf3ed5827 req-757110a9-3158-4072-96f9-928753e860b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:09.028521 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.028963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.029716 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.030142 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.034763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a56fe55f-7c32-49f5-87d1-27daf3ed5827 req-757110a9-3158-4072-96f9-928753e860b2 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.035714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a56fe55f-7c32-49f5-87d1-27daf3ed5827 req-757110a9-3158-4072-96f9-928753e860b2 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.055152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-a56fe55f-7c32-49f5-87d1-27daf3ed5827 req-757110a9-3158-4072-96f9-928753e860b2 service nova] Creating event network-changed:433e2f7b-47d6-4109-8c8b-a4880b50eadb for instance df0736cf-da48-4947-8e88-687dd441a9c2 on hv-cinder-84457 Jun 03 12:06:09.063673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:06:09.063783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-a56fe55f-7c32-49f5-87d1-27daf3ed5827 req-757110a9-3158-4072-96f9-928753e860b2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044964 Jun 03 12:06:09.063783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 316/631] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:06:09.268620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-59750167-50ca-4cc5-b26f-d89b6d85e3f1 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 204 len: 0 microversion: 2.1 time: 0.256084 Jun 03 12:06:09.275118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 316/632] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:06:09 2022] DELETE /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:06:09.284353 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:09.285604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:09.310294 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.313180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.316944 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.318621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.481812 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:09.482915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:09.502778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.505378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.506421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:09.507244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:09.606951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:09.617261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-665e9ae8-1be3-4d0d-8727-6acd66b80721 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.340275 Jun 03 12:06:09.618144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 317/633] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:09 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:09.691580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:09.699422 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:09.701045 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:09.702183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6e3c5254-9301-482a-95e8-7f074711dcf0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.225536 Jun 03 12:06:09.702732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 317/634] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:09 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:10.605892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c566e0b8-86f6-43be-855e-61f9e3e8aa25"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:10.607035 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:10.615535 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:10.615991 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:10.616755 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:10.617386 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:10.639380 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:10.640088 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:10.647374 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:10.647872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:10.648629 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:10.649060 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:10.800216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:10.807651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6d1c8bc3-f241-410d-809d-70bd570bcf19 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.174511 Jun 03 12:06:10.808387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 318/635] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:10 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:10.812730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:10.813321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:10.819652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:10.820090 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:10.820914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:10.821262 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:10.966230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:10.975808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:10.977316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:10.978466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3642b9ae-b9d9-4cf4-be53-508e9ac6674f tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.169292 Jun 03 12:06:10.979025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 319/636] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:10 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:11.825543 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:11.826186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:11.833314 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:11.833760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:11.834674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:11.835107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:11.972599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:11.980288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-69ce04d2-3f56-429a-98f8-a79e3abece3a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.158655 Jun 03 12:06:11.981055 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 320/637] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:11 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:11.996998 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:11.997697 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:12.004015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:12.004546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:12.005313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:12.005746 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:12.022009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:12.148163 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:12.156652 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:12.158227 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:12.159423 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-48892c73-04c5-48ab-bffa-831a422db7d9 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.166416 Jun 03 12:06:12.160198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 321/638] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:11 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:12.997084 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:12.997744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:13.004956 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:13.008578 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:13.015491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:13.015969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:13.165057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:13.173896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b4536e80-46c1-473e-88d0-5c22ff333e37 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.180571 Jun 03 12:06:13.174726 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 322/639] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:12 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:13.179222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:13.179915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:13.186370 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:13.186817 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:13.187604 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:13.188196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:13.327439 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:13.336598 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:13.338369 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:13.339771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a2913b5f-1346-4cc6-bb30-e5f8734b067c tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.164137 Jun 03 12:06:13.340336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 323/640] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:13 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:14.191250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:14.191983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:14.198557 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:14.198990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:14.199780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:14.200209 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:14.339371 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:14.347472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4c5753a0-ad3c-4f34-ba02-cddcef6a65ee tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.160557 Jun 03 12:06:14.357097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 324/641] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:14 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:14.357850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:14.358462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:14.364685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:14.365136 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:14.365899 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:14.366358 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:14.505596 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:14.513579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:14.515252 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:14.516677 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ef0dad3c-46f7-4276-b676-6e2254be30e8 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.162487 Jun 03 12:06:14.517240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 325/642] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:14 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:15.364710 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:15.365425 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:15.371894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:15.372342 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:15.373119 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:15.373531 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:15.509971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:15.518511 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e6ea432c-9811-434a-b447-557fc41f3908 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.156993 Jun 03 12:06:15.519292 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 326/643] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:15 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:15.535882 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:15.536486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:15.542643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:15.543081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:15.543866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:15.544291 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:15.691855 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:15.701172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:15.702668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:15.703853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e3b4ddc0-0794-487e-b712-c715ee5a5005 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.171971 Jun 03 12:06:15.704406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 327/644] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:15 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:16.536459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:16.537357 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:16.544345 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:16.544848 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:16.545675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:16.546103 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:16.685201 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:16.693605 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-41aeda63-b5a3-448a-a742-a2b8f4a5d7c4 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.161618 Jun 03 12:06:16.694279 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 328/645] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:16 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:16.722894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:16.723676 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:16.729800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:16.730242 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:16.731361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:16.731818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:16.867293 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:16.875319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:16.876845 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:16.878562 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-61e5f921-c200-48d5-9a25-bfcb79a6dc48 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.160518 Jun 03 12:06:16.879335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 329/646] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:16 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:17.710961 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:17.712445 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:17.719762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:17.720314 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:17.721758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:17.722192 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:17.863344 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:17.871781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-162212bc-84f5-417b-b200-a2fe98b0d49d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.164559 Jun 03 12:06:17.872454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 330/647] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:17 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:17.897904 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:17.898651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:17.906420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:17.906874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:17.907666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:17.908102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:18.057723 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:18.066835 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:18.068408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:18.069599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a2c6baee-b351-474d-8666-3f87c1385a04 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.176880 Jun 03 12:06:18.070348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 331/648] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:17 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:18.889396 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:18.890041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:18.897298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:18.897756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:18.898496 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:18.898924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:19.030105 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:19.038117 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2a1712fc-7ec7-45ea-99d0-25586fd00dca tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.152576 Jun 03 12:06:19.038674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 332/649] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:18 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:19.088296 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:19.088926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:19.094743 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:19.095196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:19.096625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:19.097060 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:19.225814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:19.233518 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:19.235006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:19.236177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e753ed2b-f04a-4299-a3d9-4c7d88d00f81 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.151512 Jun 03 12:06:19.237298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 333/650] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:19 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:20.054114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:20.054775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:20.061144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:20.061583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:20.062325 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:20.062747 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:20.190409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:20.197742 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-95c31342-5890-4493-a8f2-583a9129e81c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.147457 Jun 03 12:06:20.198291 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 334/651] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:20 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:20.255893 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:20.256520 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:20.262302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:20.262749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:20.263495 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:20.263946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:20.394650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:20.402773 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:20.404291 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:20.405427 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7c66e9c4-d53c-425d-a31b-4697f72d9911 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.153925 Jun 03 12:06:20.405987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 335/652] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:20 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:20.612498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=19 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:20.697049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:21.215126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:21.215679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:21.222785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:21.223226 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:21.224004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:21.224434 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:21.349999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:21.357877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d50902a6-4279-437f-af7a-cdfcfb82ef3d tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.146572 Jun 03 12:06:21.358440 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 336/653] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:21 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:21.422992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:21.423623 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:21.430106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:21.430538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:21.431276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:21.431728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:21.559734 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:21.567853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:21.570960 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:21.572165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3a2cc099-55d6-4cf0-abe9-603c3141a90d tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.153015 Jun 03 12:06:21.572917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 337/654] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:21 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:22.375257 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:22.375932 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:22.383249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:22.383734 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:22.384490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:22.384959 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:22.387470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=100 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:22.513152 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:22.521062 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-29abe8d2-48c8-497d-a34b-eeb92658a074 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.149696 Jun 03 12:06:22.521885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 338/655] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:22 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:22.590164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:22.590790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:22.597046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:22.597492 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:22.598255 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:22.598717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:22.724040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:22.731877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:22.733360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:22.734498 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-82a4599b-7fdc-43c6-8ef9-e94520486b53 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.147861 Jun 03 12:06:22.735052 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 339/656] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:22 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:23.538121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:23.538806 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:23.545143 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:23.545582 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:23.546361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:23.546784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:23.676432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:23.685763 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c940695b-f814-49c1-a213-961477a5b70a tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1568 microversion: 2.1 time: 0.150371 Jun 03 12:06:23.686331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 340/657] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:23 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:23.752215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:23.752850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:23.758765 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:23.759213 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:23.759995 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:23.760432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:23.886684 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:23.895363 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:23.897194 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:23.898364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fc2a4f53-b8d2-4839-9a29-1c4c22b8b67b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.149976 Jun 03 12:06:23.898925 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 341/658] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:23 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:24.013949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-43131d58-b70a-420b-a5b7-b6a2b8feb1cf tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.413908 Jun 03 12:06:24.014935 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 318/659] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:06:10 2022] POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-volume_attachments => generated 194 bytes in 13416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:06:24.582183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-79405c5e-51c6-419b-85c2-64ee8cb5a605 req-85c4acac-fd0b-485c-bb36-2558c76bc3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0736cf-da48-4947-8e88-687dd441a9c2", "name": "network-vif-deleted", "tag": "433e2f7b-47d6-4109-8c8b-a4880b50eadb"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:24.591633 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-79405c5e-51c6-419b-85c2-64ee8cb5a605 req-85c4acac-fd0b-485c-bb36-2558c76bc3ca service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:24.592074 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-79405c5e-51c6-419b-85c2-64ee8cb5a605 req-85c4acac-fd0b-485c-bb36-2558c76bc3ca service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:24.605673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-79405c5e-51c6-419b-85c2-64ee8cb5a605 req-85c4acac-fd0b-485c-bb36-2558c76bc3ca service nova] Creating event network-vif-deleted:433e2f7b-47d6-4109-8c8b-a4880b50eadb for instance df0736cf-da48-4947-8e88-687dd441a9c2 on hv-cinder-84457 Jun 03 12:06:24.610818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-79405c5e-51c6-419b-85c2-64ee8cb5a605 req-85c4acac-fd0b-485c-bb36-2558c76bc3ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032424 Jun 03 12:06:24.612044 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 342/660] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:06:24.703325 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:24.704059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:24.710648 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:24.711104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:24.711931 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:24.712365 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:24.775701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2bcfc5842e4faaa5369a19fce82d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c800014a3349c5aeac57178984e4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:24.783940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-77365cea-8974-4905-bdb8-f6fa799cdffe tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 200 len: 1219 microversion: 2.1 time: 0.084834 Jun 03 12:06:24.784676 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 319/661] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:24 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:24.917641 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:24.918337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:24.924727 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:24.925215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:24.925986 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:24.926423 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:25.065126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:25.073212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:25.074785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:25.076226 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-53a57a41-1d37-413f-ac97-7e1e93a77154 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.162978 Jun 03 12:06:25.076863 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 343/662] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:24 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:25.801433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:25.802102 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] [instance: df0736cf-da48-4947-8e88-687dd441a9c2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:25.808587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:25.809028 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:25.809781 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:25.810211 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:25.823815 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] HTTP exception thrown: Instance df0736cf-da48-4947-8e88-687dd441a9c2 could not be found. Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Request method failure captured: Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 HTTP/1.1 Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimffQuTrSkqs1wx5twZ64NVgQiOfWG34RKtyG_bRoJszNF5z8PtGcEQLwQ2gWb_KKJPGkazBLUnqv0SV9SvxCXMY4WPkerU-9TtFrgi9suNreDNqva4INZADF6ejxbRK6bNeRV07uh1ULQZxfy5DT_RyMC34geZfhRqElRbkkXoPdiWk Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: a7c800014a3349c5aeac57178984e4c8 Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestShelveInstance-166899895 Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:06:25.825434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a7c800014a3349c5aeac57178984e4c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a7c800014a3349c5aeac57178984e4c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a7c800014a3349c5aeac57178984e4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a7c800014a3349c5aeac57178984e4c8"}]}] Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestShelveInstance-166899895 Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: a7c800014a3349c5aeac57178984e4c8 Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestShelveInstance-166899895 Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestShelveInstance-166899895-project Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 7d2bcfc5842e4faaa5369a19fce82d26 Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestShelveInstance-166899895-project Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance df0736cf-da48-4947-8e88-687dd441a9c2 could not be found. Jun 03 12:06:25.827010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'df0736cf-da48-4947-8e88-687dd441a9c2'} Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0736cf-da48-4947-8e88-687dd441a9c2 could not be found. Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:06:25.827970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0736cf-da48-4947-8e88-687dd441a9c2 could not be found. Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0736cf-da48-4947-8e88-687dd441a9c2 could not be found. Jun 03 12:06:25.829434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:06:25.830781 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Returning 404 to user: Instance df0736cf-da48-4947-8e88-687dd441a9c2 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:06:25.830781 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fdbb766f-a974-41bf-949a-6df684e864f0 tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2" status: 404 len: 111 microversion: 2.1 time: 0.029880 Jun 03 12:06:25.830781 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 320/663] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:25 2022] GET /compute/v2.1/servers/df0736cf-da48-4947-8e88-687dd441a9c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:06:25.984136 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-80a2018a-947b-4abb-9c45-08f39aeb356c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] Calling method '.version_select at 0x7f19c59e70d0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:26.004125 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-80a2018a-947b-4abb-9c45-08f39aeb356c tempest-TestShelveInstance-166899895 tempest-TestShelveInstance-166899895-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1974840395" status: 202 len: 0 microversion: 2.1 time: 0.023740 Jun 03 12:06:26.004701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 344/664] 10.222.0.15 () {58 vars in 1253 bytes} [Fri Jun 3 12:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1974840395 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:06:26.093984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:26.094704 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:26.101746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:26.102263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:26.103023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:26.103455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:26.329399 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:26.337706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:26.339201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:26.340369 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d015ee86-9f91-4e24-a5d1-d19d4d49827e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.250257 Jun 03 12:06:26.340921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 321/665] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:26 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:27.360100 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:27.360694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:27.365915 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-30469bab-71ef-47be-b639-989878dc3e96 req-81cc0c48-a1e7-4dab-8d5c-ba1f8bded383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "name": "network-vif-plugged", "status": "completed", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:27.371302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:27.372000 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:27.372781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:27.373214 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:27.380282 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-30469bab-71ef-47be-b639-989878dc3e96 req-81cc0c48-a1e7-4dab-8d5c-ba1f8bded383 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:27.384114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-30469bab-71ef-47be-b639-989878dc3e96 req-81cc0c48-a1e7-4dab-8d5c-ba1f8bded383 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:27.407314 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-30469bab-71ef-47be-b639-989878dc3e96 req-81cc0c48-a1e7-4dab-8d5c-ba1f8bded383 service nova] Creating event network-vif-plugged:92dddd28-a98f-47bd-a228-483608919ed6 for instance 2694de28-e6b8-4a9c-b13b-74192112056c on hv-cinder-84457 Jun 03 12:06:27.414843 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-30469bab-71ef-47be-b639-989878dc3e96 req-81cc0c48-a1e7-4dab-8d5c-ba1f8bded383 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054723 Jun 03 12:06:27.416746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 322/666] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:06:27.522164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:27.531342 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:27.533952 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:27.535353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-51a94216-25da-46fa-b2aa-e40ee8024ba7 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.180948 Jun 03 12:06:27.535949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 345/667] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:27 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:06:28.554987 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:28.555701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:28.561850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:28.562291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:28.563042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:28.563472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:28.780653 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:28.810640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:28.812375 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:28.813885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1ac71de0-aab8-4223-b68a-391a4300040e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.263511 Jun 03 12:06:28.815266 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 323/668] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:28 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:29.833642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:29.834329 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:29.837826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:29.841989 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:29.842714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:29.843545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:29.844050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:30.002931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:30.012679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:30.014276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:30.015915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ed6fad1d-4f6f-4c6b-b23e-074a8d92d88a tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1732 microversion: 2.20 time: 0.187118 Jun 03 12:06:30.016642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 346/669] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:29 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:31.034936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:31.035919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:31.043441 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:31.043926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:31.044707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:31.045145 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:31.491954 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:31.504714 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:31.506693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:31.508415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e0712a69-81da-4fe2-b660-936e402082a1 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1719 microversion: 2.20 time: 0.477445 Jun 03 12:06:31.521798 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 324/670] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:06:31 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1719 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:06:31.577841 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-381369b7-b41d-43ca-8c62-6f595f3682bd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:31.586153 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-381369b7-b41d-43ca-8c62-6f595f3682bd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:31.586832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-381369b7-b41d-43ca-8c62-6f595f3682bd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:31.657285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-381369b7-b41d-43ca-8c62-6f595f3682bd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Going to try to stop instance {{(pid=117617) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 12:06:31.701026 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-381369b7-b41d-43ca-8c62-6f595f3682bd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.127028 Jun 03 12:06:31.701630 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 347/671] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:06:31 2022] POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:06:31.710383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:31.711632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:31.717380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:31.717892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:31.718806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:31.719244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:31.916830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:31.925333 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f9d7f563-98c8-4527-a5f9-f9ad92da2f9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.218836 Jun 03 12:06:31.925898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 325/672] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:31 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:32.942959 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:32.944282 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:32.955593 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:32.956048 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:32.956829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:32.957264 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:33.331742 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:33.339665 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0f07b148-a44c-4c37-bb5f-a8c210b8e652 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.401179 Jun 03 12:06:33.340320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 348/673] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:32 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:34.357355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:34.357966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:34.364532 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:34.364979 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:34.365741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:34.366173 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:34.500079 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:34.508653 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1604cd67-bdc1-4eaf-9eca-f454dc309494 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.155095 Jun 03 12:06:34.509215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 326/674] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:34 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:35.532490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:35.534271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:35.540618 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:35.541091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:35.542022 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:35.542459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:35.681919 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:35.693816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3dfaf998-bc84-4c84-9beb-161c8364aa56 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.170989 Jun 03 12:06:35.695668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 349/675] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:35 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:36.712696 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:36.713311 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:36.731801 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:36.731801 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:36.732047 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:36.732399 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:36.971955 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:36.980457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f88fd2cf-5bfd-4f6d-bce1-5fdebb0f1781 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.272369 Jun 03 12:06:36.981310 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 327/676] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:36 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:37.999701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:38.000453 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:38.008223 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:38.008664 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:38.009444 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:38.010051 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:38.232600 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:38.247968 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-684c47a2-1d39-4e47-bc1c-54fb075ec855 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.253333 Jun 03 12:06:38.249224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 350/677] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:37 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:39.268327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:39.270658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:39.282910 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:39.283626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:39.284696 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:39.285320 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:39.473702 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:39.484253 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f92a766a-8316-48a5-96a8-3c50c915de8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.221441 Jun 03 12:06:39.484946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 328/678] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:39 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:40.503316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:40.508897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:40.516415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:40.517524 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:40.518187 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:40.518613 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:40.766663 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:40.777114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b2cbc187-875b-48c9-b953-8b27254d2c64 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.277921 Jun 03 12:06:40.788771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 351/679] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:40 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:41.794501 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:41.795131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:41.807662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:41.808124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:41.808920 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:41.809364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:42.025865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:42.040946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0e893f7e-a6dc-4de3-87f6-15cfd6a0f6b6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.250209 Jun 03 12:06:42.050496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 329/680] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:41 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:43.058408 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:43.059236 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:43.080191 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:43.080837 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:43.081418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:43.081858 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:43.374550 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:43.384771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7c56d535-4321-44dc-a4b0-504d2326fcc3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.330445 Jun 03 12:06:43.398151 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 352/681] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:43 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:44.404272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:44.405247 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:44.413910 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:44.414918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:44.416453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:44.417340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:44.573943 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:44.582459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aef9149d-8d1e-4884-986a-0d2ddb246c70 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.182633 Jun 03 12:06:44.592817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 330/682] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:44 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:44.758457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-684af158-e8e1-4762-a4d3-c4b92eca0e5d tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Action: 'create', calling method: .version_select at 0x7f19c5a40040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1917680760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9sc8+4RXOQ6wG0R+bEsLATTqaJcmYtfst1vMKjNovYifQtsO769pUXvTmQkZunhIxe74PwW4bHnQNrXWT6fT+tOcSXFls/r1o//pNF8nbdec2Cc2Von2YKAEstnbxerg=="}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:44.773361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-684af158-e8e1-4762-a4d3-c4b92eca0e5d tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for project adff32783b7a479d89e34cd1e5a118d6. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:06:44.778009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-684af158-e8e1-4762-a4d3-c4b92eca0e5d tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for user 79c5b9ec7d2248918e884cd01adb84c6 and project adff32783b7a479d89e34cd1e5a118d6. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:06:44.806193 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-684af158-e8e1-4762-a4d3-c4b92eca0e5d tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.309812 Jun 03 12:06:44.806795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 353/683] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:06:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:06:45.599343 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:45.599977 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:45.606335 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:45.606787 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:45.607610 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:45.608004 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:45.754291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:45.762266 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-184ae2f0-fec1-412d-9a19-fee934eada0a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.166926 Jun 03 12:06:45.762825 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 331/684] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:45 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:46.780157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:46.780782 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:46.788359 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:46.788820 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:46.789574 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:46.790010 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:46.926195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:46.934899 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-38bbfc26-fb1b-48f4-89d8-b9bd777cf010 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1724 microversion: 2.1 time: 0.158549 Jun 03 12:06:46.935487 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 354/685] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:46 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:47.952399 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:47.953016 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:47.960635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:47.961083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:47.961899 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:47.962393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:48.151335 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:48.164450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d1894939-8216-47a1-b7e3-44473b3bc9c9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1701 microversion: 2.1 time: 0.216089 Jun 03 12:06:48.165132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 332/686] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:47 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1701 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:48.181283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4c6ebcde-69db-4782-964b-ff8648812182 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:06:48.188042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c6ebcde-69db-4782-964b-ff8648812182 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:48.189036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c6ebcde-69db-4782-964b-ff8648812182 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:48.214178 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4c6ebcde-69db-4782-964b-ff8648812182 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Going to try to start instance {{(pid=117617) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 12:06:48.242731 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:48.273971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4c6ebcde-69db-4782-964b-ff8648812182 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.096398 Jun 03 12:06:48.274528 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 355/687] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:06:48 2022] POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:06:48.283271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:48.283940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:48.290477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:48.291160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:48.292218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:48.292627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:48.496477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:48.504376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-eaf7afd1-247f-4630-9b6e-c7284dd56f2b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1710 microversion: 2.1 time: 0.225807 Jun 03 12:06:48.504941 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 333/688] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:48 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:06:49.524025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:49.525002 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:49.531836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:49.532315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:49.533097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:49.533532 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:49.665075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:49.674086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ce44cd83-ba4a-4e11-95a7-7e7bfb1e09a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1710 microversion: 2.1 time: 0.155041 Jun 03 12:06:49.674773 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 356/689] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:49 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:06:50.691342 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:06:50.691973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:06:50.694359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=31 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:50.700643 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:50.701198 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:50.701973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:06:50.702419 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:06:50.705097 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:50.837415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:06:50.846222 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1878a543-057d-4dda-a4d1-a601c29020f2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1714 microversion: 2.1 time: 0.158599 Jun 03 12:06:50.846804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 334/690] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:06:50 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:06.145269 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:07:06.145925 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:07:07.228559 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1409868963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1917680760", "security_groups": [{"name": "tempest-secgroup-smoke-972159627"}], "block_device_mapping_v2": [{"uuid": "fdd77fdc-9eb8-4929-8972-545a6f3e751b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1099c87b-fd5a-4442-acb6-6dd6fbd0317b"}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:07.237058 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=4 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:07.237910 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:07.238563 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:07.341600 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] validate_networks() for [('1099c87b-fd5a-4442-acb6-6dd6fbd0317b', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:07:07.692457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:07:07.692874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:07:07.693361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:07:07.694376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:07:07.694781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:07:07.703477 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:07.703945 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:07.704721 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:07.705150 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:07.721138 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for project adff32783b7a479d89e34cd1e5a118d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:07:07.724987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for user 79c5b9ec7d2248918e884cd01adb84c6 and project adff32783b7a479d89e34cd1e5a118d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:07:07.780035 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:07:07.782095 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdd77fdc-9eb8-4929-8972-545a6f3e751b',volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:07:07.906239 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-48cde614-7b73-4117-a18b-814e9f7209de tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681428 Jun 03 12:07:07.906883 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 357/691] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:07:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:07:07.917271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-610061c1-100d-4fb3-85b3-a669a8e18e41 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:07.917917 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-610061c1-100d-4fb3-85b3-a669a8e18e41 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:07.920385 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:07.921223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=5 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:07.973789 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-610061c1-100d-4fb3-85b3-a669a8e18e41 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:07.981063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-610061c1-100d-4fb3-85b3-a669a8e18e41 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1095 microversion: 2.1 time: 0.067691 Jun 03 12:07:07.981659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 335/692] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:07 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:08.998719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:08.999327 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:09.006174 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:09.006625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:09.007399 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:09.007871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:09.075135 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:09.083735 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f290549e-d69c-4e2f-8ff4-d6d5e9c61de3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1201 microversion: 2.1 time: 0.089004 Jun 03 12:07:09.093793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 358/693] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:08 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:10.101997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:10.102626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:10.110913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:10.111433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:10.112304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:10.112804 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:10.344803 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:10.354159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a5a7bfea-6178-4d4a-8074-84437b9da369 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.256422 Jun 03 12:07:10.354657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 336/694] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:10 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:07:10.490559 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-265d7194-4325-4d62-97a4-c0d31d67d210 req-8c946d4d-333a-48b0-a438-2f9d5b8e355d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54e6c04-b883-43f5-b6d8-8ab782570d09", "tag": "095156de-3191-4de5-a75a-f0e566ce9fd8"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:10.501247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-265d7194-4325-4d62-97a4-c0d31d67d210 req-8c946d4d-333a-48b0-a438-2f9d5b8e355d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:10.501746 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-265d7194-4325-4d62-97a4-c0d31d67d210 req-8c946d4d-333a-48b0-a438-2f9d5b8e355d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:10.515198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-265d7194-4325-4d62-97a4-c0d31d67d210 req-8c946d4d-333a-48b0-a438-2f9d5b8e355d service nova] Creating event network-changed:095156de-3191-4de5-a75a-f0e566ce9fd8 for instance e54e6c04-b883-43f5-b6d8-8ab782570d09 on hv-cinder-84457 Jun 03 12:07:10.520897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-265d7194-4325-4d62-97a4-c0d31d67d210 req-8c946d4d-333a-48b0-a438-2f9d5b8e355d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034154 Jun 03 12:07:10.523529 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 359/695] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:07:11.370600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:11.371213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:11.377661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:11.378106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:11.378865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:11.379301 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:11.508328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:11.515763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-18d0ee92-c068-41bb-b00c-d0bccc4f71cf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.148998 Jun 03 12:07:11.516313 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 337/696] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:11 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:12.533159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:12.533765 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:12.540583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:12.541037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:12.541792 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:12.542234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:12.667283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:12.674657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3f264659-4c01-40fd-946b-defb8031ace7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.145741 Jun 03 12:07:12.675217 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 360/697] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:12 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:13.692676 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:13.693284 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:13.700348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:13.700801 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:13.701558 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:13.701993 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:13.829904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:13.837530 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ffc971e9-0d54-4d5f-8c59-06f5f9c465b9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.148701 Jun 03 12:07:13.838086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 338/698] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:13 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:14.855231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:14.855854 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:14.861864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:14.862302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:14.863046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:14.863473 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:14.992780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:15.000438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0fb4cd48-528a-4bbc-9ec5-0269df832079 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.149751 Jun 03 12:07:15.000990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 361/699] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:14 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:16.016364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:16.016978 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:16.023761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:16.024218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:16.024990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:16.025429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:16.164745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:16.172034 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e726d1b9-ac23-47bf-9459-36a93d310406 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.159534 Jun 03 12:07:16.172699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 339/700] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:16 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:17.189255 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:17.189907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:17.196834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:17.197271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:17.198042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:17.198467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:17.328545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:17.335948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-87da6f6c-7688-4c44-b6c3-99c92ff641d6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.150537 Jun 03 12:07:17.336509 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 362/701] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:17 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:18.352623 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:18.353259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:18.355584 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:18.361219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:18.361675 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:18.362445 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:18.362890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:18.646937 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:18.654316 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bef47c72-3b01-4beb-bba0-8547f03e26b0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.305573 Jun 03 12:07:18.654852 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 340/702] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:18 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:19.670648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:19.671391 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:19.673486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:19.674157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:19.681651 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:19.682102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:19.682870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:19.683309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:19.816679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:19.824669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bda5ec05-3321-4dd3-a3c4-f259c12313c1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.158487 Jun 03 12:07:19.825230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 363/703] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:19 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:20.840842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:20.841451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:20.848110 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:20.848551 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:20.849303 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:20.849732 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:20.977422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:20.984910 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8010b478-d6a8-4aae-ac36-f20b17b9f955 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.147967 Jun 03 12:07:20.985461 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 341/704] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:20 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:21.648376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-1bfbb548-c00a-4663-8342-5fb21bff17d3 req-53c7d172-3acf-4e95-83fb-3e394a103527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54e6c04-b883-43f5-b6d8-8ab782570d09", "name": "network-vif-plugged", "status": "completed", "tag": "095156de-3191-4de5-a75a-f0e566ce9fd8"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:21.656801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-1bfbb548-c00a-4663-8342-5fb21bff17d3 req-53c7d172-3acf-4e95-83fb-3e394a103527 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:21.657237 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-1bfbb548-c00a-4663-8342-5fb21bff17d3 req-53c7d172-3acf-4e95-83fb-3e394a103527 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:21.668960 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-1bfbb548-c00a-4663-8342-5fb21bff17d3 req-53c7d172-3acf-4e95-83fb-3e394a103527 service nova] Creating event network-vif-plugged:095156de-3191-4de5-a75a-f0e566ce9fd8 for instance e54e6c04-b883-43f5-b6d8-8ab782570d09 on hv-cinder-84457 Jun 03 12:07:21.673926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-1bfbb548-c00a-4663-8342-5fb21bff17d3 req-53c7d172-3acf-4e95-83fb-3e394a103527 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029847 Jun 03 12:07:21.674575 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 364/705] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:22.003191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:22.003838 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:22.010789 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:22.011235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:22.012037 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:22.012471 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:22.281879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:22.289850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4c7cb948-a7f5-4136-a6b7-cd074e2ebdd7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.291467 Jun 03 12:07:22.290404 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 342/706] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:21 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:23.307901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:23.308604 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:23.314743 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:23.315193 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:23.315981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:23.316421 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:23.442711 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:23.451106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6716d099-f02b-43ab-bb61-071625875459 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1266 microversion: 2.1 time: 0.148422 Jun 03 12:07:23.451724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 365/707] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:23 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:24.468638 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:24.469250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:24.476391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:24.476836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:24.477591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:24.478024 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:24.609123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:24.617275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6d5fd5d3-b549-490e-83b9-02a84b782895 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1453 microversion: 2.1 time: 0.152544 Jun 03 12:07:24.617832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 343/708] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:24 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:24.632882 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:24.633748 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:24.640336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:24.640779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:24.641529 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:24.641953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:24.767658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:24.776316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-81c882f2-622b-4ac9-a9a3-d989aa392335 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1453 microversion: 2.1 time: 0.147298 Jun 03 12:07:24.776873 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 366/709] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:24 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:26.430244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-ef15fac2-62da-4e74-b523-b3c0cef76ac7 req-9eedac16-15f6-4f2b-9fcf-7fc8d1c9c74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54e6c04-b883-43f5-b6d8-8ab782570d09", "tag": "095156de-3191-4de5-a75a-f0e566ce9fd8"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:26.438709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-ef15fac2-62da-4e74-b523-b3c0cef76ac7 req-9eedac16-15f6-4f2b-9fcf-7fc8d1c9c74c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:26.439156 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-ef15fac2-62da-4e74-b523-b3c0cef76ac7 req-9eedac16-15f6-4f2b-9fcf-7fc8d1c9c74c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:26.450584 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-ef15fac2-62da-4e74-b523-b3c0cef76ac7 req-9eedac16-15f6-4f2b-9fcf-7fc8d1c9c74c service nova] Creating event network-changed:095156de-3191-4de5-a75a-f0e566ce9fd8 for instance e54e6c04-b883-43f5-b6d8-8ab782570d09 on hv-cinder-84457 Jun 03 12:07:26.455525 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-ef15fac2-62da-4e74-b523-b3c0cef76ac7 req-9eedac16-15f6-4f2b-9fcf-7fc8d1c9c74c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029404 Jun 03 12:07:26.456307 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 344/710] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:30.409877 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:30.410795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:30.417390 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:30.417833 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:30.418579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:30.419010 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:30.446771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-55fc21a8-ca94-40b9-bd6b-9a6b5cefc935 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040825 Jun 03 12:07:30.447313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 367/711] 10.222.0.15 () {60 vars in 1342 bytes} [Fri Jun 3 12:07:30 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:30.503750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:30.504326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:30.510836 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:30.511281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:30.512061 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:30.512495 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:30.536638 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:07:30.607986 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f2cd21e3-fb84-4411-ab6b-b41f598df46b tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 204 len: 0 microversion: 2.20 time: 0.108658 Jun 03 12:07:30.608592 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 345/712] 10.222.0.15 () {60 vars in 1279 bytes} [Fri Jun 3 12:07:30 2022] DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 12:07:30.617170 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:30.617779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:30.623751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:30.624196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:30.624942 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:30.625371 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:30.754237 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:30.762702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:30.764234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:30.765377 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-33b8935a-3293-47bb-99cb-1ae88771c15e tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.152616 Jun 03 12:07:30.765926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 368/713] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:07:30 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 12:07:31.784048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:31.784751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:31.791255 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:31.791751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:31.792513 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:31.792950 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:31.924466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:31.932356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:31.933847 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:31.934990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-169c7546-9bfc-46ec-a2be-b77835248f90 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1725 microversion: 2.20 time: 0.155392 Jun 03 12:07:31.935554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 346/714] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:07:31 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:07:32.953558 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:32.954158 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:32.961289 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:32.961726 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:32.962475 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:32.962901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:33.026107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:33.034081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:33.035732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b76f9ea7268a4e70a402f3c9ea6220e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89467b1c15334264bf384b711292808b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:33.037533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e9384c1b-65c9-4882-ba83-787be5a700d0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 200 len: 1657 microversion: 2.20 time: 0.087219 Jun 03 12:07:33.038091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 369/715] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:07:32 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:07:33.064145 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-e2d82375-3362-46b6-940f-9db03efbba9e req-1e3c519b-e036-4d19-956f-7099dbcd0de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2694de28-e6b8-4a9c-b13b-74192112056c", "name": "network-vif-deleted", "tag": "92dddd28-a98f-47bd-a228-483608919ed6"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:33.074316 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e2d82375-3362-46b6-940f-9db03efbba9e req-1e3c519b-e036-4d19-956f-7099dbcd0de1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:33.074766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e2d82375-3362-46b6-940f-9db03efbba9e req-1e3c519b-e036-4d19-956f-7099dbcd0de1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:33.087487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-e2d82375-3362-46b6-940f-9db03efbba9e req-1e3c519b-e036-4d19-956f-7099dbcd0de1 service nova] Creating event network-vif-deleted:92dddd28-a98f-47bd-a228-483608919ed6 for instance 2694de28-e6b8-4a9c-b13b-74192112056c on hv-cinder-84457 Jun 03 12:07:33.092651 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-e2d82375-3362-46b6-940f-9db03efbba9e req-1e3c519b-e036-4d19-956f-7099dbcd0de1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Jun 03 12:07:33.093410 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 347/716] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:34.056002 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:34.056602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:34.063104 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:34.063579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:34.064328 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:34.064756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:34.077681 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] HTTP exception thrown: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Request method failure captured: Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c HTTP/1.1 Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdsvAlVyk-Urqywe3zaRNKCmLbip6yhDt0hqmBqLGgi17ICqR_CqUPwJKNct_5EqfkgVeYg7k9eIHiLoTem7wJ4sxUFMBKylcxsjQ_xAxc21mVrwv1F44nOrmWGRFQp9VzumRmHd4iUrdi1OcZ5oMTgytj-Ju9Op2xoe4VohWlqlGk Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:07:34.079285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_89467b1c15334264bf384b711292808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/89467b1c15334264bf384b711292808b"}]}] Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: b76f9ea7268a4e70a402f3c9ea6220e7 Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:34.081011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '2694de28-e6b8-4a9c-b13b-74192112056c'} Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:07:34.081871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:34.083429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:34.084746 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Returning 404 to user: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:07:34.084746 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-27e1e9b2-15ae-4054-a28f-706b59160762 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 404 len: 111 microversion: 2.20 time: 0.029267 Jun 03 12:07:34.084746 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 370/717] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:07:34 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:07:34.090371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-554afbf1-9297-4ab1-a7eb-0430dfee73c0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '.version_select at 0x7f19c5aba4c0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:34.111588 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-554afbf1-9297-4ab1-a7eb-0430dfee73c0 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790293578" status: 204 len: 0 microversion: 2.20 time: 0.025701 Jun 03 12:07:34.112140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 348/718] 10.222.0.15 () {60 vars in 1261 bytes} [Fri Jun 3 12:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790293578 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 03 12:07:35.845428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:35.845923 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:35.853139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:35.853588 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:35.854415 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:35.854873 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:35.870741 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] HTTP exception thrown: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Request method failure captured: Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c HTTP/1.1 Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdsvAlVyk-Urqywe3zaRNKCmLbip6yhDt0hqmBqLGgi17ICqR_CqUPwJKNct_5EqfkgVeYg7k9eIHiLoTem7wJ4sxUFMBKylcxsjQ_xAxc21mVrwv1F44nOrmWGRFQp9VzumRmHd4iUrdi1OcZ5oMTgytj-Ju9Op2xoe4VohWlqlGk Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:07:35.872322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_89467b1c15334264bf384b711292808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/89467b1c15334264bf384b711292808b"}]}] Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: b76f9ea7268a4e70a402f3c9ea6220e7 Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.873799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '2694de28-e6b8-4a9c-b13b-74192112056c'} Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:07:35.874671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.876137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.877905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Returning 404 to user: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:07:35.877905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fc385132-9f70-4c79-8684-6a7a4c622028 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 404 len: 111 microversion: 2.20 time: 0.032203 Jun 03 12:07:35.877905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 371/719] 10.222.0.15 () {60 vars in 1279 bytes} [Fri Jun 3 12:07:35 2022] DELETE /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:07:35.883361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:35.884212 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: 2694de28-e6b8-4a9c-b13b-74192112056c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:35.891645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:35.892102 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:35.892864 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:35.893300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:35.907265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] HTTP exception thrown: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Request method failure captured: Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c HTTP/1.1 Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdsvAlVyk-Urqywe3zaRNKCmLbip6yhDt0hqmBqLGgi17ICqR_CqUPwJKNct_5EqfkgVeYg7k9eIHiLoTem7wJ4sxUFMBKylcxsjQ_xAxc21mVrwv1F44nOrmWGRFQp9VzumRmHd4iUrdi1OcZ5oMTgytj-Ju9Op2xoe4VohWlqlGk Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:07:35.908940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_89467b1c15334264bf384b711292808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/89467b1c15334264bf384b711292808b"}]}] Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: b76f9ea7268a4e70a402f3c9ea6220e7 Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.910552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '2694de28-e6b8-4a9c-b13b-74192112056c'} Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:07:35.911699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. Jun 03 12:07:35.913451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:35.914706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Returning 404 to user: Instance 2694de28-e6b8-4a9c-b13b-74192112056c could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:07:35.914706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-43969385-8306-4542-8aa4-ee624478f872 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c" status: 404 len: 111 microversion: 2.20 time: 0.031396 Jun 03 12:07:35.914706 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 349/720] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:07:35 2022] GET /compute/v2.1/servers/2694de28-e6b8-4a9c-b13b-74192112056c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:07:37.044152 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:37.044640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:37.050959 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:37.051402 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:37.052183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:37.052611 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:37.065470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] HTTP exception thrown: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Request method failure captured: Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe HTTP/1.1 Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfdsvAlVyk-Urqywe3zaRNKCmLbip6yhDt0hqmBqLGgi17ICqR_CqUPwJKNct_5EqfkgVeYg7k9eIHiLoTem7wJ4sxUFMBKylcxsjQ_xAxc21mVrwv1F44nOrmWGRFQp9VzumRmHd4iUrdi1OcZ5oMTgytj-Ju9Op2xoe4VohWlqlGk Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:07:37.067017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_89467b1c15334264bf384b711292808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/89467b1c15334264bf384b711292808b"}]}] Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: b76f9ea7268a4e70a402f3c9ea6220e7 Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.069168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'a5e00459-a0d4-4520-bc60-02901fe74ffe'} Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:07:37.070031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.071456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.072885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Returning 404 to user: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:07:37.072885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-db1b9757-f87f-4f4d-9f19-f6605e641032 tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 404 len: 111 microversion: 2.20 time: 0.028535 Jun 03 12:07:37.072885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 372/721] 10.222.0.15 () {60 vars in 1279 bytes} [Fri Jun 3 12:07:37 2022] DELETE /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:07:37.077237 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:37.077846 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] [instance: a5e00459-a0d4-4520-bc60-02901fe74ffe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:37.084936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:37.085379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:37.086136 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:37.086572 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:37.099624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] HTTP exception thrown: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Request method failure captured: Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe HTTP/1.1 Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfdsvAlVyk-Urqywe3zaRNKCmLbip6yhDt0hqmBqLGgi17ICqR_CqUPwJKNct_5EqfkgVeYg7k9eIHiLoTem7wJ4sxUFMBKylcxsjQ_xAxc21mVrwv1F44nOrmWGRFQp9VzumRmHd4iUrdi1OcZ5oMTgytj-Ju9Op2xoe4VohWlqlGk Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:07:37.101163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_89467b1c15334264bf384b711292808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/89467b1c15334264bf384b711292808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/89467b1c15334264bf384b711292808b"}]}] Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 89467b1c15334264bf384b711292808b Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1956539554 Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: b76f9ea7268a4e70a402f3c9ea6220e7 Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1956539554-project Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.102745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'a5e00459-a0d4-4520-bc60-02901fe74ffe'} Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:07:37.103655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. Jun 03 12:07:37.105067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:07:37.106453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] Returning 404 to user: Instance a5e00459-a0d4-4520-bc60-02901fe74ffe could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:07:37.106453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c2e67024-d887-46dd-bdf6-eeb368cf0efd tempest-AttachVolumeShelveTestJSON-1956539554 tempest-AttachVolumeShelveTestJSON-1956539554-project] 10.222.0.15 "GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe" status: 404 len: 111 microversion: 2.20 time: 0.029222 Jun 03 12:07:37.106453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 350/722] 10.222.0.15 () {60 vars in 1276 bytes} [Fri Jun 3 12:07:37 2022] GET /compute/v2.1/servers/a5e00459-a0d4-4520-bc60-02901fe74ffe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:07:45.409518 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-36397ec5-e530-4a49-b5f3-18f4b6ab7b01 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: .version_select at 0x7f19c59e79d0>, body: {"keypair": {"name": "tempest-keypair-323344712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO38Rf1l22b28mvMtIIHEeFiEmXGq/UOGl7Joifi9YiNX+PZbkncBO6noopqaaD5x1LnPmpiT2Ydw+046SNCivU4HgLIzlP4NH7WU3KqoaLf/MKTyMrB4bBwjRx5PSacQ=="}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:45.414350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:45.426796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-36397ec5-e530-4a49-b5f3-18f4b6ab7b01 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:07:45.431146 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-36397ec5-e530-4a49-b5f3-18f4b6ab7b01 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:07:45.454850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-36397ec5-e530-4a49-b5f3-18f4b6ab7b01 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165844 Jun 03 12:07:45.455450 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 373/723] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:07:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:46.742349 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-509444439", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d93d3bc-8776-4cd1-bb83-66977617e90d"}], "security_groups": [{"name": "tempest-securitygroup--1626709038"}], "key_name": "tempest-keypair-323344712", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:46.754138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:46.861522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] validate_networks() for [('5d93d3bc-8776-4cd1-bb83-66977617e90d', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:07:47.092037 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:47.264807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:07:47.265349 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:07:47.265934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:07:47.266451 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:07:47.266969 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:07:47.278682 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:47.279295 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:47.280255 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:47.280863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:47.299107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:07:47.304275 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:07:47.320875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:47.321494 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:47.322631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:07:47.325272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:07:47.329017 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=72 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:47.331892 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:47.333472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:47.334702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:47.335342 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:47.387452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7bd63db4-897a-4bb3-808b-586b9e482920 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.649415 Jun 03 12:07:47.395093 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 351/724] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:07:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:07:47.408121 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d17d3b1b-f89a-42ed-bd6d-a637038b3824 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:47.410500 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d17d3b1b-f89a-42ed-bd6d-a637038b3824 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:47.475671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lazy-loading 'services' on Instance uuid d7dd2271-e4e4-4e18-b2e4-69993351fdfb {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:07:47.521868 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d17d3b1b-f89a-42ed-bd6d-a637038b3824 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:47.529189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d17d3b1b-f89a-42ed-bd6d-a637038b3824 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1240 microversion: 2.1 time: 0.132628 Jun 03 12:07:47.529760 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 352/725] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:47 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:47.630686 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8c0225ca-8490-4a5a-991a-2dee8c259cf3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-volume_attachments/c566e0b8-86f6-43be-855e-61f9e3e8aa25" status: 202 len: 0 microversion: 2.1 time: 0.313592 Jun 03 12:07:47.635902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 374/726] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:07:47 2022] DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-volume_attachments/c566e0b8-86f6-43be-855e-61f9e3e8aa25 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 12:07:48.546348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:48.547112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:48.554118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:48.554589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:48.555349 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:48.555834 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:48.623040 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:48.631741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-520b3e3a-0a88-461e-8f54-952ad7622d69 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1292 microversion: 2.1 time: 0.089293 Jun 03 12:07:48.632300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 353/727] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:48 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:48.794008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3bf7361b-962a-444e-a302-513a65de4f8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:48.802526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3bf7361b-962a-444e-a302-513a65de4f8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:48.803342 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3bf7361b-962a-444e-a302-513a65de4f8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:48.827056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3bf7361b-962a-444e-a302-513a65de4f8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Going to try to stop instance {{(pid=117617) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 12:07:48.887337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3bf7361b-962a-444e-a302-513a65de4f8a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.097563 Jun 03 12:07:48.888169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 375/728] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:07:48 2022] POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:07:48.898356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:48.902906 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:48.910007 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:48.911156 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:48.912250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:48.912859 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:49.123058 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:49.130976 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e7c74d47-f464-4bf8-ba15-ca0942d343f5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.237949 Jun 03 12:07:49.131759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 354/729] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:48 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:49.650133 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:49.650828 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:49.657122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:49.657572 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:49.658371 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:49.658801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:49.721999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:49.730210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6d46d1ab-cba6-48d0-8dc4-a78866c794c6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1298 microversion: 2.1 time: 0.085353 Jun 03 12:07:49.730784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 376/730] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:49 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:50.149578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:50.150963 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:50.157824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:50.158208 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:50.158972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:50.159404 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:50.409927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:50.418143 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9851912d-c6d2-4cfd-8020-0b9f23916005 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.273449 Jun 03 12:07:50.418712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 355/731] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:50 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:07:50.746078 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:50.746797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:50.754174 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:50.754717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:50.756208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:50.756716 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:50.855818 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-23480d47-e039-4aaf-be06-7a983a8653d1 req-fe847b3f-a77f-449e-891d-aa97e84dc752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbc147a-97ca-458c-b45e-1df8bdf916df", "tag": "26fc72b3-64e6-4686-ba10-4b5b74149d05"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:50.865774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-23480d47-e039-4aaf-be06-7a983a8653d1 req-fe847b3f-a77f-449e-891d-aa97e84dc752 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:50.866713 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-23480d47-e039-4aaf-be06-7a983a8653d1 req-fe847b3f-a77f-449e-891d-aa97e84dc752 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:50.883808 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-23480d47-e039-4aaf-be06-7a983a8653d1 req-fe847b3f-a77f-449e-891d-aa97e84dc752 service nova] Creating event network-changed:26fc72b3-64e6-4686-ba10-4b5b74149d05 for instance ccbc147a-97ca-458c-b45e-1df8bdf916df on hv-cinder-84457 Jun 03 12:07:50.889066 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-23480d47-e039-4aaf-be06-7a983a8653d1 req-fe847b3f-a77f-449e-891d-aa97e84dc752 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037619 Jun 03 12:07:50.893910 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 356/732] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:07:50.909395 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:50.918057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6d05cde2-17ce-4426-8d3f-f8bdc13346e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1366 microversion: 2.1 time: 0.175003 Jun 03 12:07:50.918779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 377/733] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:50 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:51.435740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:51.436492 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:51.443141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:51.443621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:51.444396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:51.444829 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:51.571777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:51.579290 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-65ed1fef-3429-4d61-ad1a-ee79205de3ca tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.148321 Jun 03 12:07:51.579879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 357/734] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:51 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:51.934738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:51.935341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:51.942207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:51.942315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:51.943674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:51.944106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:52.072229 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:52.079449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-57a0cd6d-ef4e-48f2-b9ff-687bd19ffa4e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1366 microversion: 2.1 time: 0.148547 Jun 03 12:07:52.080025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 378/735] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:51 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:52.596805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:52.597440 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:52.604241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:52.604687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:52.605444 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:52.605885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:52.736105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:52.744356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f6dc85a2-2458-4f3e-8705-188a575ac223 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.151413 Jun 03 12:07:52.744920 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 358/736] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:52 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:53.096029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:53.096635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:53.103620 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:53.104068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:53.104816 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:53.105255 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:53.391257 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:53.399613 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f1d9ee30-2f5f-4a39-a650-eaa6bf5ed8b3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1366 microversion: 2.1 time: 0.307359 Jun 03 12:07:53.400166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 379/737] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:53 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:53.761777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:53.762382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:53.769358 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:53.769810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:53.770625 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:53.771863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:53.973389 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:53.981454 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4ea457c2-7451-43b4-90fb-5b2a7f4fd49e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.223458 Jun 03 12:07:53.982062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 359/738] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:53 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:54.416013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:54.416634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:54.423127 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:54.423614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:54.424375 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:54.424811 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:54.548868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:54.556130 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2bbb92dc-8447-4be6-86a6-11fb233ccf31 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1366 microversion: 2.1 time: 0.143977 Jun 03 12:07:54.556679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 380/739] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:54 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:55.000287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:55.000894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:55.007354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:55.007828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:55.008576 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:55.009006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:55.133748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:55.141160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e7e235e3-0ecb-414f-bc7c-7e65a5a4d542 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.144740 Jun 03 12:07:55.141747 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 360/740] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:54 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:55.572584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:55.573183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:55.575610 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=4 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:55.580996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:55.581432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:55.582179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:55.582604 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:55.712286 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:55.719847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a76f0879-c14f-4428-8283-368bd88132a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1366 microversion: 2.1 time: 0.150986 Jun 03 12:07:55.720401 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 381/741] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:55 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:07:55.800328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-a1a03122-ce14-4405-8a1c-9580876720d1 req-b7c6ab49-5586-4e07-8921-83305eefabd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbc147a-97ca-458c-b45e-1df8bdf916df", "name": "network-vif-plugged", "status": "completed", "tag": "26fc72b3-64e6-4686-ba10-4b5b74149d05"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:55.809228 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a1a03122-ce14-4405-8a1c-9580876720d1 req-b7c6ab49-5586-4e07-8921-83305eefabd0 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:55.809626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a1a03122-ce14-4405-8a1c-9580876720d1 req-b7c6ab49-5586-4e07-8921-83305eefabd0 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:55.822314 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-a1a03122-ce14-4405-8a1c-9580876720d1 req-b7c6ab49-5586-4e07-8921-83305eefabd0 service nova] Creating event network-vif-plugged:26fc72b3-64e6-4686-ba10-4b5b74149d05 for instance ccbc147a-97ca-458c-b45e-1df8bdf916df on hv-cinder-84457 Jun 03 12:07:55.827700 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-a1a03122-ce14-4405-8a1c-9580876720d1 req-b7c6ab49-5586-4e07-8921-83305eefabd0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030849 Jun 03 12:07:55.828527 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 361/742] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:56.158356 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:56.158901 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:56.165009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:56.165460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:56.166254 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:56.166718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:56.295619 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:56.303759 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-88d16d64-8435-4e19-b604-fec1a44f8f5d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.149310 Jun 03 12:07:56.304316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 382/743] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:56 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:56.737196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:56.737903 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:56.745287 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:56.745740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:56.746497 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:56.746938 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:56.876793 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:56.884144 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3b245219-b748-4bde-85f3-1531afaf96a8 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1366 microversion: 2.1 time: 0.151170 Jun 03 12:07:56.884709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 362/744] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:56 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:57.320503 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:57.321091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:57.327430 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:57.327907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:57.328658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:57.329089 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:57.454220 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:57.462448 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-de29b249-1fda-480f-9ba6-deda59698360 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.146365 Jun 03 12:07:57.463224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 383/745] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:57 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:57.901548 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:57.902997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:57.905040 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:57.906209 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=8 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:57.914844 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:57.915295 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:57.916104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:57.916553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:58.051104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:58.059457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-df674746-55ad-442c-b423-7b0f997b1af9 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1556 microversion: 2.1 time: 0.161875 Jun 03 12:07:58.060038 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 363/746] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:57 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:58.075284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:58.075804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:58.081700 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:58.082148 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:58.082909 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:58.083338 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:58.160721 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ca0a875c-8b20-4e00-891d-cc01f4c1e8a2 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089164 Jun 03 12:07:58.161818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 384/747] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:07:58 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:58.479474 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:58.480107 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:58.486015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:58.486456 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:58.487213 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:58.487673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:58.620972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:58.628650 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-30ee2b05-ed36-4000-8a54-645e58829443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1678 microversion: 2.1 time: 0.153024 Jun 03 12:07:58.629291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 364/748] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:58 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:59.056778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-6b3205aa-17df-4733-ab05-8dcd10b800a1 req-d23c0b2d-33ea-43b1-b0e5-faf4f07bb903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbc147a-97ca-458c-b45e-1df8bdf916df", "tag": "26fc72b3-64e6-4686-ba10-4b5b74149d05"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:59.065010 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-6b3205aa-17df-4733-ab05-8dcd10b800a1 req-d23c0b2d-33ea-43b1-b0e5-faf4f07bb903 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:59.065454 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-6b3205aa-17df-4733-ab05-8dcd10b800a1 req-d23c0b2d-33ea-43b1-b0e5-faf4f07bb903 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:59.076656 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-6b3205aa-17df-4733-ab05-8dcd10b800a1 req-d23c0b2d-33ea-43b1-b0e5-faf4f07bb903 service nova] Creating event network-changed:26fc72b3-64e6-4686-ba10-4b5b74149d05 for instance ccbc147a-97ca-458c-b45e-1df8bdf916df on hv-cinder-84457 Jun 03 12:07:59.081921 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-6b3205aa-17df-4733-ab05-8dcd10b800a1 req-d23c0b2d-33ea-43b1-b0e5-faf4f07bb903 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030003 Jun 03 12:07:59.082501 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 385/749] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:07:59.647076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:59.648059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:59.656106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:59.656561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:59.657340 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:59.657929 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:59.815919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:07:59.825264 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d17a14d6-1d82-4c2f-9a5e-2fd5d3eef384 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1655 microversion: 2.1 time: 0.182960 Jun 03 12:07:59.826032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 365/750] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:59 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1655 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:07:59.849469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7402fec6-d289-4e86-9fea-7784e37e17d4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:07:59.856381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7402fec6-d289-4e86-9fea-7784e37e17d4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:59.856835 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7402fec6-d289-4e86-9fea-7784e37e17d4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:59.882341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7402fec6-d289-4e86-9fea-7784e37e17d4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Going to try to start instance {{(pid=117617) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 12:07:59.927457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7402fec6-d289-4e86-9fea-7784e37e17d4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.083815 Jun 03 12:07:59.928168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 386/751] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:07:59 2022] POST /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:07:59.936405 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:07:59.937111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:07:59.943433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:59.944115 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:07:59.944847 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:07:59.945289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:08:00.147866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:08:00.155459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ae22306b-65e0-4888-99c8-cb6a11602394 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1664 microversion: 2.1 time: 0.223087 Jun 03 12:08:00.156258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 366/752] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:07:59 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1664 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:08:01.174902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:08:01.175608 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:08:01.182324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:08:01.182762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:08:01.183521 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:08:01.183962 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:08:01.312996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:08:01.320395 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b06539ba-705e-4a65-9f9b-92bf6b43bb6a tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1664 microversion: 2.1 time: 0.150167 Jun 03 12:08:01.320948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 387/753] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:08:01 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:08:02.337049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:08:02.337650 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:08:02.344102 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:08:02.344544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:08:02.345288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:08:02.345717 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:08:02.480065 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:08:02.487846 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8fd10ab8-d5d6-494f-95ac-022a822d2ade tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1668 microversion: 2.1 time: 0.155061 Jun 03 12:08:02.488435 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 367/754] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:08:02 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:05.760859 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:05.761635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:05.766065 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:05.767053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:05.775632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:05.776086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:05.776849 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:05.777286 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:05.806908 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8280bd4a-57be-4143-ba79-1a8ca43f484f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047960 Jun 03 12:09:05.807464 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 388/755] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:09:05 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:09:05.860755 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:05.861496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=84 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:05.865415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:05.865902 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:05.872783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:05.873224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:05.873976 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:05.874406 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:05.899651 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:09:05.971078 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1e9c1978-ed53-486e-b84d-a3e650c9f6dd tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 204 len: 0 microversion: 2.1 time: 0.111700 Jun 03 12:09:05.971823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 368/756] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:09:05 2022] DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:09:05.981459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:05.982056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:05.988018 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:05.988456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:05.989193 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:05.989619 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:06.164852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:06.172315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f904f159-7304-4121-94ea-cdad2f1a3d19 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1674 microversion: 2.1 time: 0.195130 Jun 03 12:09:06.172883 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 389/757] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:05 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:07.190269 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:07.190889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:07.197041 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:07.197505 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:07.198243 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:07.198673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:07.379553 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:07.386908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ab118e91-47a4-4e03-837c-a13fbc3562a5 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1674 microversion: 2.1 time: 0.201278 Jun 03 12:09:07.387465 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 369/758] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:07 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:08.404538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:08.405137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:08.411633 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:08.412093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:08.412842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:08.413271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:08.540562 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:08.548146 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-eb5d28e6-5f0f-49ee-9fcf-7bde42bcf2ce tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1674 microversion: 2.1 time: 0.147450 Jun 03 12:09:08.548703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 390/759] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:08 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:09.139943 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-73cee568-8a02-42f9-88e7-fb69f1cd9daf req-b123ee55-f1da-41a9-8b11-aaf7cf515796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dd2271-e4e4-4e18-b2e4-69993351fdfb", "name": "network-vif-deleted", "tag": "ea2d2af1-a2e2-4462-b153-e3177e0b7809"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:09.149826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-73cee568-8a02-42f9-88e7-fb69f1cd9daf req-b123ee55-f1da-41a9-8b11-aaf7cf515796 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:09.150388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-73cee568-8a02-42f9-88e7-fb69f1cd9daf req-b123ee55-f1da-41a9-8b11-aaf7cf515796 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:09.167047 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-73cee568-8a02-42f9-88e7-fb69f1cd9daf req-b123ee55-f1da-41a9-8b11-aaf7cf515796 service nova] Creating event network-vif-deleted:ea2d2af1-a2e2-4462-b153-e3177e0b7809 for instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb on hv-cinder-84457 Jun 03 12:09:09.174726 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-73cee568-8a02-42f9-88e7-fb69f1cd9daf req-b123ee55-f1da-41a9-8b11-aaf7cf515796 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105790 Jun 03 12:09:09.176114 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 370/760] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:09.566060 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:09.567414 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:09.574539 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:09.574992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:09.576378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:09.576843 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:09.611830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:09.612244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:09.612689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lazy-loading 'fault' on Instance uuid d7dd2271-e4e4-4e18-b2e4-69993351fdfb {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:09:09.657250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:09.664710 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f4aa5224-be35-4d83-9a0c-0ee691f0fd0d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 200 len: 1328 microversion: 2.1 time: 0.102739 Jun 03 12:09:09.665262 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 391/761] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:09 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:10.683601 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:10.684290 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:10.690395 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:10.690839 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:10.691608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:10.692040 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:10.705575 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] HTTP exception thrown: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Request method failure captured: Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb HTTP/1.1 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfjWXbs3hOs0SNZRniOetm5MnuMcPt8P6PI0AwxgDaULHFxWJ68QC487LcvSFa8IdWojgebFTUk4SC7yROrhRHuha1t8CuS7SX4SCqI1KJ6IdkD1bPmEbuaREnbeFToWTjJ0Jov8J1yU4LL3dIYBU-_h8R8v-pO7C_rjeKTwrIuUq44 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: db41a74c9582485b9def49d558170121 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:09:10.707149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db41a74c9582485b9def49d558170121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db41a74c9582485b9def49d558170121"}]}] Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: db41a74c9582485b9def49d558170121 Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 76db57106a684c7592dc8cba4bc0a9d7 Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:09:10.708796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'd7dd2271-e4e4-4e18-b2e4-69993351fdfb'} Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:09:10.709766 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:09:10.711306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:10.712666 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Returning 404 to user: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:09:10.712666 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aa498b21-2aeb-4f96-97c1-e1947099a54e tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 404 len: 111 microversion: 2.1 time: 0.029944 Jun 03 12:09:10.712666 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 371/762] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:10 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:09:10.717171 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-eb3977ff-27c8-4dfb-b3c1-a4f04409745b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '.version_select at 0x7f19c59ff040>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:10.734745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-eb3977ff-27c8-4dfb-b3c1-a4f04409745b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185905067" status: 202 len: 0 microversion: 2.1 time: 0.021283 Jun 03 12:09:10.735279 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 392/763] 10.222.0.15 () {58 vars in 1220 bytes} [Fri Jun 3 12:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185905067 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:09:11.566418 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e7b2bc41-4845-49df-afed-059a842b5666 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: .version_select at 0x7f19c5aa3f70>, body: {"keypair": {"name": "tempest-keypair-1878601809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDSFpWAaJKSrT5g4sDy5QceVVOXdS5RBh2srLMr91U2qr/y6z6diumF9V2wd/6IlbjMp1g2jivCQIUQHmHZLxqKZBs2RhPDXcjI0L5oV7KAbtL6V+KQ5OMDU+pk/jnBcQ=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:11.580951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e7b2bc41-4845-49df-afed-059a842b5666 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for project db41a74c9582485b9def49d558170121. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:09:11.585391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e7b2bc41-4845-49df-afed-059a842b5666 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for user 76db57106a684c7592dc8cba4bc0a9d7 and project db41a74c9582485b9def49d558170121. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:09:11.605830 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e7b2bc41-4845-49df-afed-059a842b5666 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043365 Jun 03 12:09:11.606406 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 372/764] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:09:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:09:12.858584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-598502994", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03361f06-4300-4076-a569-cdce901f3442"}], "security_groups": [{"name": "tempest-securitygroup--1008179649"}], "key_name": "tempest-keypair-1878601809", "user_data": "}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:12.958434 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] validate_networks() for [('03361f06-4300-4076-a569-cdce901f3442', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:09:13.327851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:09:13.328279 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:09:13.328753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:09:13.329192 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:09:13.329602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:09:13.338777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:13.339221 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:13.340040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:13.340476 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:13.357103 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for project db41a74c9582485b9def49d558170121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:09:13.360991 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Getting quotas for user 76db57106a684c7592dc8cba4bc0a9d7 and project db41a74c9582485b9def49d558170121. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:09:13.371679 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:09:13.373875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:09:13.419570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bc13a31a-3de3-468d-a39c-ebfd4cf525b3 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565702 Jun 03 12:09:13.420206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 393/765] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:09:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:09:13.430044 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d93340eb-3bcd-42dc-9de1-0aa8ef5d63d9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:13.430655 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d93340eb-3bcd-42dc-9de1-0aa8ef5d63d9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:13.487824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d93340eb-3bcd-42dc-9de1-0aa8ef5d63d9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:13.494815 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d93340eb-3bcd-42dc-9de1-0aa8ef5d63d9 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1237 microversion: 2.1 time: 0.068496 Jun 03 12:09:13.495316 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 373/766] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:13 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:14.088324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:14.088938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:14.095101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:14.095368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:14.096157 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:14.096587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:14.121545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ce29a203-de05-4230-9a4f-c85e22d86f08 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/ips" status: 200 len: 150 microversion: 2.1 time: 0.037041 Jun 03 12:09:14.122287 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 394/767] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:09:14 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:14.511090 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:14.511812 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:14.518022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:14.518469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:14.519232 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:14.519925 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:14.598947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:14.607807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-179fd7a7-9c99-4fb7-bf6a-d301939d4c9f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1297 microversion: 2.1 time: 0.100598 Jun 03 12:09:14.608371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 374/768] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:14 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:15.461807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:15.462953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:15.469469 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:15.469912 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:15.470669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:15.471110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:15.626905 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:15.627600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:15.644940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:15.651633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:15.652541 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:15.652997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:15.767373 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fc99e31e-e8e0-4ec4-958b-2472c798d5ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310005 Jun 03 12:09:15.767945 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 395/769] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:09:15 2022] POST /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:15.894777 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:15.904020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4c8d2949-976d-4e37-82fd-bd7ca04ab443 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.282073 Jun 03 12:09:15.904589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 375/770] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:15 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:09:16.398140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-94558370-f5d2-4066-836f-93ac1689a3e6 req-f21964c2-8bb7-4ff8-96fa-96e8ad6e253e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56d73ac-456c-400f-97ee-5b205eab2aa5", "tag": "d49f1b59-eee0-4ff4-92db-e5781200d1ef"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:16.414194 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-94558370-f5d2-4066-836f-93ac1689a3e6 req-f21964c2-8bb7-4ff8-96fa-96e8ad6e253e service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:16.414838 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-94558370-f5d2-4066-836f-93ac1689a3e6 req-f21964c2-8bb7-4ff8-96fa-96e8ad6e253e service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:16.426963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-94558370-f5d2-4066-836f-93ac1689a3e6 req-f21964c2-8bb7-4ff8-96fa-96e8ad6e253e service nova] Creating event network-changed:d49f1b59-eee0-4ff4-92db-e5781200d1ef for instance b56d73ac-456c-400f-97ee-5b205eab2aa5 on hv-cinder-84457 Jun 03 12:09:16.431873 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-94558370-f5d2-4066-836f-93ac1689a3e6 req-f21964c2-8bb7-4ff8-96fa-96e8ad6e253e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038741 Jun 03 12:09:16.432387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 396/771] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:16.920242 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:16.920878 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:16.927288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:16.927774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:16.928535 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:16.928972 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:17.138181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:17.145711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1ad51fad-fbb8-4856-9854-f6b619dceb57 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.229496 Jun 03 12:09:17.146263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 376/772] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:16 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:18.163716 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:18.164321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:18.170452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:18.170891 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:18.171673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:18.172103 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:18.300702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:18.308167 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6e5c3241-ee89-4cfe-a5bf-cf3fcce93b52 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.149784 Jun 03 12:09:18.308715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 397/773] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:18 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:19.325063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:19.325667 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:19.332104 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:19.332548 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:19.333300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:19.333729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:19.460603 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:19.467973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4959e233-1d6b-4145-a1f1-3afb1abce047 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.146749 Jun 03 12:09:19.468527 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 377/774] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:19 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:20.484703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:20.485239 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:20.491836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:20.492288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:20.493040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:20.493498 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:20.619509 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:20.626814 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4b8531e0-b2c8-4235-b526-e6645c2cd710 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.146057 Jun 03 12:09:20.627364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 398/775] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:20 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:21.643393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:21.644049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:21.650997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:21.651445 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:21.652228 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:21.652663 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:21.781971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:21.789959 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f0e365c1-324d-420c-8c40-d9b81fa69c45 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.150462 Jun 03 12:09:21.790510 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 378/776] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:21 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:22.327898 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-1a47a5c7-8e38-4675-8801-d2b149e5cedb req-42b2c4f6-1e15-4d82-bbf9-4448a6758497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56d73ac-456c-400f-97ee-5b205eab2aa5", "name": "network-vif-plugged", "status": "completed", "tag": "d49f1b59-eee0-4ff4-92db-e5781200d1ef"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:22.335910 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-1a47a5c7-8e38-4675-8801-d2b149e5cedb req-42b2c4f6-1e15-4d82-bbf9-4448a6758497 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:22.336352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-1a47a5c7-8e38-4675-8801-d2b149e5cedb req-42b2c4f6-1e15-4d82-bbf9-4448a6758497 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:22.346847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-1a47a5c7-8e38-4675-8801-d2b149e5cedb req-42b2c4f6-1e15-4d82-bbf9-4448a6758497 service nova] Creating event network-vif-plugged:d49f1b59-eee0-4ff4-92db-e5781200d1ef for instance b56d73ac-456c-400f-97ee-5b205eab2aa5 on hv-cinder-84457 Jun 03 12:09:22.351720 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-1a47a5c7-8e38-4675-8801-d2b149e5cedb req-42b2c4f6-1e15-4d82-bbf9-4448a6758497 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083355 Jun 03 12:09:22.352285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 399/777] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:22.807343 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:22.808006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:22.814487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:22.814941 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:22.815741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:22.816183 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:22.946428 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:22.953879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7dec4f0e-98f9-4c69-a875-8b34416cbe81 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.150449 Jun 03 12:09:22.954439 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 379/778] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:22 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:23.260907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2a00c0de-72c1-49d8-aaf3-8485b4e76a2a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: .version_select at 0x7f19c59ffaf0>, body: {"keypair": {"name": "tempest-keypair-2088134802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWryjc0CyE2wYJS6Ids7WUmcrIuaqkvZT9EXkudqEw+r7TDQUnc/A1u7ESB6x/qEblu5NuIjXJdijCrCT57z2AOM/+KgWFE8Ozs5WfrLqBU0jUeCEA6fvwIxHR61bVxmA=="}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:23.275900 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-2a00c0de-72c1-49d8-aaf3-8485b4e76a2a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:09:23.279818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-2a00c0de-72c1-49d8-aaf3-8485b4e76a2a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:09:23.301569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2a00c0de-72c1-49d8-aaf3-8485b4e76a2a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045049 Jun 03 12:09:23.302135 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 400/779] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:09:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:23.970426 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:23.971015 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:23.972962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:23.978693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:23.979138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:23.979928 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:23.980356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:24.194357 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:24.201996 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5e845881-dc20-46cc-a49f-ef9be3ea33ac tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1363 microversion: 2.1 time: 0.235610 Jun 03 12:09:24.202746 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 380/780] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:23 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:24.604637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:24.609748 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-887910172", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d93d3bc-8776-4cd1-bb83-66977617e90d"}], "security_groups": [{"name": "tempest-securitygroup--1046444513"}], "key_name": "tempest-keypair-2088134802", "user_data": "}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:24.706830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] validate_networks() for [('5d93d3bc-8776-4cd1-bb83-66977617e90d', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:09:25.065777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:09:25.066199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:09:25.066667 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:09:25.067101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:09:25.067523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:09:25.076809 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:25.077248 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:25.078028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:25.078462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:25.094924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:09:25.098807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:09:25.109490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:09:25.112042 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:09:25.158500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bb89eac5-078c-436c-a249-6ee6ccc545fa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.554622 Jun 03 12:09:25.159128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 401/781] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:09:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:09:25.168945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3fc283a7-6efb-49ad-8eb1-eedd5097d238 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:25.169555 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3fc283a7-6efb-49ad-8eb1-eedd5097d238 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:25.218535 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:25.219265 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:25.225835 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:25.226285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:25.226735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fc283a7-6efb-49ad-8eb1-eedd5097d238 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:25.227047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:25.227479 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:25.234718 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3fc283a7-6efb-49ad-8eb1-eedd5097d238 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1241 microversion: 2.1 time: 0.069622 Jun 03 12:09:25.235468 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 381/782] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:25 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:25.366481 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:25.373892 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-65ba3301-3855-4d95-bbdb-53d75012a169 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1550 microversion: 2.1 time: 0.159242 Jun 03 12:09:25.374445 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 402/783] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:25 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:09:25.390759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:25.391254 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:25.398095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:25.398730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:25.399656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:25.400227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:25.484290 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d9c6ca44-f8c4-43ff-bb5c-19787155a99f tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097495 Jun 03 12:09:25.484911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 382/784] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:09:25 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:26.251286 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:26.251947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:26.258337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:26.258791 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:26.259683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:26.260438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:26.352066 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:26.359468 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6bab8f7a-a056-45ce-83f9-ecfb8cf2587c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1299 microversion: 2.1 time: 0.112372 Jun 03 12:09:26.360068 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 403/785] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:26 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:26.433432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-e9aacd8a-a608-4e32-8d16-0df059234ac7 req-1b48453a-1617-4baf-a3df-fe2fe2264ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56d73ac-456c-400f-97ee-5b205eab2aa5", "tag": "d49f1b59-eee0-4ff4-92db-e5781200d1ef"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:26.441703 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e9aacd8a-a608-4e32-8d16-0df059234ac7 req-1b48453a-1617-4baf-a3df-fe2fe2264ba8 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:26.442420 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e9aacd8a-a608-4e32-8d16-0df059234ac7 req-1b48453a-1617-4baf-a3df-fe2fe2264ba8 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:26.454999 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-e9aacd8a-a608-4e32-8d16-0df059234ac7 req-1b48453a-1617-4baf-a3df-fe2fe2264ba8 service nova] Creating event network-changed:d49f1b59-eee0-4ff4-92db-e5781200d1ef for instance b56d73ac-456c-400f-97ee-5b205eab2aa5 on hv-cinder-84457 Jun 03 12:09:26.460832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-e9aacd8a-a608-4e32-8d16-0df059234ac7 req-1b48453a-1617-4baf-a3df-fe2fe2264ba8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031753 Jun 03 12:09:26.461413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 383/786] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:27.376718 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:27.377927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:27.385891 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:27.386120 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:27.386897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:27.387337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:27.545228 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:27.553631 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e4db53b3-0ba4-496f-bb17-efc2a3a32ebb tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.180931 Jun 03 12:09:27.554494 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 404/787] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:27 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:28.100698 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-4d0aef9b-bbcc-480b-a977-5ed11800b1bf req-290524ac-db21-4ef2-9e24-f504afbce881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1394f44-138a-4b23-b949-b6537e47c60f", "tag": "bf0c3f30-335b-468b-9d30-80212798fa55"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:28.124271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4d0aef9b-bbcc-480b-a977-5ed11800b1bf req-290524ac-db21-4ef2-9e24-f504afbce881 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:28.124815 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4d0aef9b-bbcc-480b-a977-5ed11800b1bf req-290524ac-db21-4ef2-9e24-f504afbce881 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:28.139241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-4d0aef9b-bbcc-480b-a977-5ed11800b1bf req-290524ac-db21-4ef2-9e24-f504afbce881 service nova] Creating event network-changed:bf0c3f30-335b-468b-9d30-80212798fa55 for instance d1394f44-138a-4b23-b949-b6537e47c60f on hv-cinder-84457 Jun 03 12:09:28.144164 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-4d0aef9b-bbcc-480b-a977-5ed11800b1bf req-290524ac-db21-4ef2-9e24-f504afbce881 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054195 Jun 03 12:09:28.144757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 384/788] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:28.569251 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:28.569885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:28.577099 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:28.577655 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:28.578445 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:28.578872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:28.704320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:28.712199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bbe0b5ea-4670-4627-a693-4e2458ade4c5 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.146851 Jun 03 12:09:28.712752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 405/789] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:28 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:29.730120 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:29.730820 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:29.737032 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:29.737479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:29.738231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:29.738666 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:30.092027 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:30.099362 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7985b47b-13e6-4f5c-8ec0-84417e38342d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.374435 Jun 03 12:09:30.099940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 385/790] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:29 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:31.116436 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:31.117039 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:31.123407 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:31.123879 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:31.124626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:31.125053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:31.253714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:31.261276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b20b8235-80d2-430a-baf5-03fb616388c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.149230 Jun 03 12:09:31.261829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 406/791] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:31 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:32.278695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:32.279315 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:32.286366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:32.286820 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:32.288280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:32.288727 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:32.419478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:32.426845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0505f602-5261-4b9d-813d-b5d6b93ae827 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.152012 Jun 03 12:09:32.427403 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 386/792] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:32 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:33.443518 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:33.444064 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:33.450486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:33.450926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:33.451696 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:33.452123 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:33.577533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:33.580914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:33.586117 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-09b71b9b-2b01-43fc-8bd4-f16fdecf9eb6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.146543 Jun 03 12:09:33.586682 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 407/793] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:33 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:34.309831 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-12b93549-ec9a-4e6d-8d3b-56175eb08c87 req-a4c591db-1c8d-4d30-9603-3461f034220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1394f44-138a-4b23-b949-b6537e47c60f", "name": "network-vif-plugged", "status": "completed", "tag": "bf0c3f30-335b-468b-9d30-80212798fa55"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:34.318628 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-12b93549-ec9a-4e6d-8d3b-56175eb08c87 req-a4c591db-1c8d-4d30-9603-3461f034220d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:34.319070 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-12b93549-ec9a-4e6d-8d3b-56175eb08c87 req-a4c591db-1c8d-4d30-9603-3461f034220d service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:34.330276 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-12b93549-ec9a-4e6d-8d3b-56175eb08c87 req-a4c591db-1c8d-4d30-9603-3461f034220d service nova] Creating event network-vif-plugged:bf0c3f30-335b-468b-9d30-80212798fa55 for instance d1394f44-138a-4b23-b949-b6537e47c60f on hv-cinder-84457 Jun 03 12:09:34.335800 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-12b93549-ec9a-4e6d-8d3b-56175eb08c87 req-a4c591db-1c8d-4d30-9603-3461f034220d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029629 Jun 03 12:09:34.336381 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 387/794] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:34.603438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:34.604072 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:34.611056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:34.611491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:34.612259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:34.612687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:34.743394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:34.750659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-043eb004-bf08-4eec-a504-9410ad6fbab0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.152313 Jun 03 12:09:34.751208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 408/795] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:34 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:35.765155 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:35.769837 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:35.770544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:35.777762 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:35.778212 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:35.778982 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:35.779417 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:35.912203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:35.914844 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:35.921636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9c689c42-3c69-49a0-8d03-ee21fcd8f275 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1367 microversion: 2.1 time: 0.157391 Jun 03 12:09:35.922177 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 388/796] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:35 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:36.938128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:36.938767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:36.940609 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:36.941284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=16 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:36.942441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:36.948996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:36.949438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:36.950195 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:36.950628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:37.076902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:37.084847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f848b85d-ffda-495c-992e-d45265d90e55 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1557 microversion: 2.1 time: 0.149964 Jun 03 12:09:37.085401 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 409/797] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:36 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:37.100632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:37.101105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:37.103712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:37.109537 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:37.109977 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:37.110722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:37.111149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:37.187657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-66798826-2b63-4cfc-b4cb-e1f97b8292c3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090708 Jun 03 12:09:37.189176 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 389/798] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:09:37 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:38.096695 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-1a5c35d8-1717-4cda-94ad-5afd6ef706cf req-ef09e455-0e3c-470e-b90f-8cb0429fc2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1394f44-138a-4b23-b949-b6537e47c60f", "tag": "bf0c3f30-335b-468b-9d30-80212798fa55"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:38.105830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-1a5c35d8-1717-4cda-94ad-5afd6ef706cf req-ef09e455-0e3c-470e-b90f-8cb0429fc2ae service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:38.106273 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-1a5c35d8-1717-4cda-94ad-5afd6ef706cf req-ef09e455-0e3c-470e-b90f-8cb0429fc2ae service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:38.117706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-1a5c35d8-1717-4cda-94ad-5afd6ef706cf req-ef09e455-0e3c-470e-b90f-8cb0429fc2ae service nova] Creating event network-changed:bf0c3f30-335b-468b-9d30-80212798fa55 for instance d1394f44-138a-4b23-b949-b6537e47c60f on hv-cinder-84457 Jun 03 12:09:38.122585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-1a5c35d8-1717-4cda-94ad-5afd6ef706cf req-ef09e455-0e3c-470e-b90f-8cb0429fc2ae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029787 Jun 03 12:09:38.123363 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 410/799] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:43.679033 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:43.679608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:43.685534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:43.685987 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:43.686768 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:43.687201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:43.710701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:09:43.782096 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d18a3a9f-68f1-478a-a843-e0d92cd16109 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 204 len: 0 microversion: 2.1 time: 0.107814 Jun 03 12:09:43.782911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 390/800] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:09:43 2022] DELETE /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:09:43.792589 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:43.793299 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:43.799830 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:43.800331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:43.801260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:43.801702 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:43.931310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:43.938838 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5b20200c-a7a5-4ebb-9835-ed31862d5615 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1577 microversion: 2.1 time: 0.151789 Jun 03 12:09:43.939456 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 411/801] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:43 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:44.957304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:44.958001 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:44.964866 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:44.965313 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:44.966087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:44.966518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:45.099111 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:45.107348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-88267eaf-7200-4cad-a27b-bde25447d783 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1577 microversion: 2.1 time: 0.154214 Jun 03 12:09:45.107954 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 391/802] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:44 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:46.124302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:46.125047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:46.131896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:46.132335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:46.133086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:46.133513 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:46.199922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:46.207446 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4acdffd1-b5e2-4c71-921e-ce3a222c61f1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1510 microversion: 2.1 time: 0.086952 Jun 03 12:09:46.208140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 412/803] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:46 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1510 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:09:46.425361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-fa9d9a59-ae27-4361-a754-ae2cbd0bc885 req-d515254d-6eaf-46e1-8f34-da3663519214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54e6c04-b883-43f5-b6d8-8ab782570d09", "name": "network-vif-deleted", "tag": "095156de-3191-4de5-a75a-f0e566ce9fd8"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:46.435191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-fa9d9a59-ae27-4361-a754-ae2cbd0bc885 req-d515254d-6eaf-46e1-8f34-da3663519214 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:46.435663 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-fa9d9a59-ae27-4361-a754-ae2cbd0bc885 req-d515254d-6eaf-46e1-8f34-da3663519214 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:46.448113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-fa9d9a59-ae27-4361-a754-ae2cbd0bc885 req-d515254d-6eaf-46e1-8f34-da3663519214 service nova] Creating event network-vif-deleted:095156de-3191-4de5-a75a-f0e566ce9fd8 for instance e54e6c04-b883-43f5-b6d8-8ab782570d09 on hv-cinder-84457 Jun 03 12:09:46.453584 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-fa9d9a59-ae27-4361-a754-ae2cbd0bc885 req-d515254d-6eaf-46e1-8f34-da3663519214 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Jun 03 12:09:46.454218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 392/804] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:09:47.224340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:47.225861 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:47.233265 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:47.233841 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:47.234553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:47.234993 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:47.269954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:47.270404 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:47.270856 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lazy-loading 'fault' on Instance uuid e54e6c04-b883-43f5-b6d8-8ab782570d09 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:09:47.319985 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:47.327833 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c16233d2-986a-4ed6-861d-aab836b5384c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 200 len: 1231 microversion: 2.1 time: 0.107317 Jun 03 12:09:47.328545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 413/805] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:47 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:48.346126 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:48.346824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:48.353571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:48.354020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:48.354774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:48.355210 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:48.368805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] HTTP exception thrown: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Request method failure captured: Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 HTTP/1.1 Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimflPgSAfBosI_mqTbl22r9fgg03o38kGwqZkV7y_lWIr74QEMON6xgRYnSzzKpub6PLGy2XrLpL-k3CVtFbuTc4PqTFvEekyW0uWabk-jx4VKNeKeRcfPLzUWu-bYxyWyRX3vDRsHb9gRcMFh4b9tJN-hUbtBloUEWBi4KOt1TF9zhc Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:09:48.370396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/adff32783b7a479d89e34cd1e5a118d6"}]}] Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestVolumeBootPattern-996662452 Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 79c5b9ec7d2248918e884cd01adb84c6 Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:09:48.372105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'e54e6c04-b883-43f5-b6d8-8ab782570d09'} Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:09:48.373020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:09:48.374533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:09:48.375882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Returning 404 to user: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:09:48.375882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5a4be07e-b522-409c-9189-e002e96fd155 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 404 len: 111 microversion: 2.1 time: 0.030386 Jun 03 12:09:48.375882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 393/806] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:48 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:09:48.463935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1148137120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1917680760", "security_groups": [{"name": "tempest-secgroup-smoke-972159627"}], "block_device_mapping_v2": [{"uuid": "fdd77fdc-9eb8-4929-8972-545a6f3e751b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1099c87b-fd5a-4442-acb6-6dd6fbd0317b"}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:48.572072 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] validate_networks() for [('1099c87b-fd5a-4442-acb6-6dd6fbd0317b', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:09:48.928687 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:09:48.929104 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:09:48.929573 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:09:48.929974 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:09:48.930378 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:09:48.939097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:48.939560 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:48.940344 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:48.940775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:48.957420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for project adff32783b7a479d89e34cd1e5a118d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:09:48.961926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for user 79c5b9ec7d2248918e884cd01adb84c6 and project adff32783b7a479d89e34cd1e5a118d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:09:49.016405 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:09:49.018470 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdd77fdc-9eb8-4929-8972-545a6f3e751b',volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:09:49.141093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-750bf2dd-8142-4476-80f4-92059fb35fcf tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.680971 Jun 03 12:09:49.141730 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 414/807] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:09:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:09:49.153042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a174ba35-8cd8-41ed-85fd-05b422a64ab4 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:49.153772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a174ba35-8cd8-41ed-85fd-05b422a64ab4 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:49.208547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a174ba35-8cd8-41ed-85fd-05b422a64ab4 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:49.216035 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a174ba35-8cd8-41ed-85fd-05b422a64ab4 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1095 microversion: 2.1 time: 0.067507 Jun 03 12:09:49.216592 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 394/808] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:49 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:50.232394 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:50.233011 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:50.239576 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:50.240033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:50.240836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:50.241271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:50.306420 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:50.315635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0fc6ea90-a5fe-4bfe-b5a8-82a4e6068201 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1211 microversion: 2.1 time: 0.086994 Jun 03 12:09:50.316202 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 415/809] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:50 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:51.332566 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:51.333828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:51.341055 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:51.341432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:51.342197 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:51.342627 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:51.534565 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:51.550083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8a2cf972-56d8-4ccb-9c64-d1d034d4bd66 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.221146 Jun 03 12:09:51.550683 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 395/810] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:51 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:51.614093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-f77e700e-6b51-447d-95df-ae97d52e0965 req-0189c179-b8f2-4eae-b5aa-b83082df59bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222f9db1-5f76-4953-9403-0570342e19af", "tag": "25d47bd3-2b7d-4bd9-8b2a-51978d9b195e"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:09:51.624815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-f77e700e-6b51-447d-95df-ae97d52e0965 req-0189c179-b8f2-4eae-b5aa-b83082df59bd service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:51.625609 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-f77e700e-6b51-447d-95df-ae97d52e0965 req-0189c179-b8f2-4eae-b5aa-b83082df59bd service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:51.639321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-f77e700e-6b51-447d-95df-ae97d52e0965 req-0189c179-b8f2-4eae-b5aa-b83082df59bd service nova] Creating event network-changed:25d47bd3-2b7d-4bd9-8b2a-51978d9b195e for instance 222f9db1-5f76-4953-9403-0570342e19af on hv-cinder-84457 Jun 03 12:09:51.644837 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-f77e700e-6b51-447d-95df-ae97d52e0965 req-0189c179-b8f2-4eae-b5aa-b83082df59bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035030 Jun 03 12:09:51.645833 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 416/811] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:09:52.568743 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:52.569358 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:52.575861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:52.576316 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:52.577079 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:52.577520 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:52.706547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:52.714086 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b01d0fb1-b449-4857-9ac7-b3517aaa9057 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.149853 Jun 03 12:09:52.714647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 396/812] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:52 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:53.731280 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:53.732040 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:53.738346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:53.738797 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:53.739583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:53.740056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:53.872242 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:53.879656 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-13be4f38-5592-4159-af96-e1a36df4e66b tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.153045 Jun 03 12:09:53.880231 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 417/813] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:53 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:54.897538 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:54.898401 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:54.904980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:54.905430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:54.906200 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:54.906638 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:55.036185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:55.043684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e49080be-368f-49c5-9be2-244817b61b70 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.150619 Jun 03 12:09:55.044253 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 397/814] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:54 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:56.060508 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:56.061118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:56.067594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:56.068686 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:56.069439 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:56.069884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:56.195926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:56.203267 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-40d84def-2826-476f-a6f2-9bd3b10e211f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.146737 Jun 03 12:09:56.203847 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 418/815] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:56 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:57.219880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:57.220482 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:57.227328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:57.227801 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:57.228549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:57.228980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:57.359686 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:57.367639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9bd0c77b-4553-4282-bf4b-cc094b94514f tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.151604 Jun 03 12:09:57.368206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 398/816] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:57 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:58.384465 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:58.385093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:58.391557 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:58.392005 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:58.392752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:58.393175 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:58.518782 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:58.526926 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8a33057e-ad6e-4c84-8526-2bb06edc8598 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.146629 Jun 03 12:09:58.527480 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 419/817] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:58 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:09:59.543541 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:09:59.544091 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:09:59.546551 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:59.552170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:59.552615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:59.553368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:09:59.553799 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:09:59.682084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:09:59.689620 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b0edb28c-1986-4d17-93ed-e0149f960dbb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.150100 Jun 03 12:09:59.690172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 399/818] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:09:59 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:00.706233 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:00.706837 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:00.708990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:00.709638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:00.715930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:00.716374 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:00.717126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:00.717555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:00.848039 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:00.855774 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-de2a4ba4-15ad-4af3-bd90-2eea742df4d9 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.153263 Jun 03 12:10:00.856348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 420/819] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:00 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:01.872306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:01.872908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:01.879359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:01.879831 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:01.880574 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:01.881001 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:02.008260 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:02.015620 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-833583fd-d06d-4cec-b363-dd454afe6f15 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.147120 Jun 03 12:10:02.016166 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 400/820] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:01 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:02.385147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-0b921eca-6f84-4d74-8549-cd7670869f20 req-a207c079-486f-4845-86f3-805b0c21fb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222f9db1-5f76-4953-9403-0570342e19af", "name": "network-vif-plugged", "status": "completed", "tag": "25d47bd3-2b7d-4bd9-8b2a-51978d9b195e"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:10:02.393979 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-0b921eca-6f84-4d74-8549-cd7670869f20 req-a207c079-486f-4845-86f3-805b0c21fb32 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:02.394414 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-0b921eca-6f84-4d74-8549-cd7670869f20 req-a207c079-486f-4845-86f3-805b0c21fb32 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:02.406144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-0b921eca-6f84-4d74-8549-cd7670869f20 req-a207c079-486f-4845-86f3-805b0c21fb32 service nova] Creating event network-vif-plugged:25d47bd3-2b7d-4bd9-8b2a-51978d9b195e for instance 222f9db1-5f76-4953-9403-0570342e19af on hv-cinder-84457 Jun 03 12:10:02.411025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-0b921eca-6f84-4d74-8549-cd7670869f20 req-a207c079-486f-4845-86f3-805b0c21fb32 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029587 Jun 03 12:10:02.412368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 421/821] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:03.033068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:03.033612 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:03.040248 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:03.040696 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:03.041452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:03.041889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:03.181838 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:03.189593 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a10d6b70-e319-4cfb-9e40-58fdb36a52db tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1266 microversion: 2.1 time: 0.160385 Jun 03 12:10:03.190170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 401/822] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:03 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:04.207330 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:04.207963 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:04.214758 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:04.215207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:04.215991 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:04.216428 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:04.344832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:04.352346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-15521f69-39b9-4f73-aed4-7fa597acd130 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1454 microversion: 2.1 time: 0.149766 Jun 03 12:10:04.352898 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 422/823] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:04 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:04.368787 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:04.369395 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:04.375763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:04.376205 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:04.376953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:04.377381 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:04.509891 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:04.517683 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-76b77c14-ce19-48e8-8e61-ec2e3872b5c7 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1454 microversion: 2.1 time: 0.153127 Jun 03 12:10:04.518443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 402/824] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:04 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:06.342338 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-ed9a0eb2-1f76-4d9e-817d-1b0ace1b9666 req-5ea593d9-0cb4-4196-a778-3fc03933f95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222f9db1-5f76-4953-9403-0570342e19af", "tag": "25d47bd3-2b7d-4bd9-8b2a-51978d9b195e"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:10:06.350777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-ed9a0eb2-1f76-4d9e-817d-1b0ace1b9666 req-5ea593d9-0cb4-4196-a778-3fc03933f95c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:06.351692 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-ed9a0eb2-1f76-4d9e-817d-1b0ace1b9666 req-5ea593d9-0cb4-4196-a778-3fc03933f95c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:06.354250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=77 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:06.364007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-ed9a0eb2-1f76-4d9e-817d-1b0ace1b9666 req-5ea593d9-0cb4-4196-a778-3fc03933f95c service nova] Creating event network-changed:25d47bd3-2b7d-4bd9-8b2a-51978d9b195e for instance 222f9db1-5f76-4953-9403-0570342e19af on hv-cinder-84457 Jun 03 12:10:06.369249 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-ed9a0eb2-1f76-4d9e-817d-1b0ace1b9666 req-5ea593d9-0cb4-4196-a778-3fc03933f95c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030542 Jun 03 12:10:06.370387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 423/825] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:41.613690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:41.614484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:41.680383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:41.681009 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:41.688734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:41.689297 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:41.690317 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:41.690880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:41.720394 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f983b8a1-2e6a-4a7c-bfb5-e192bb9c2080 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/ips" status: 200 len: 147 microversion: 2.1 time: 0.111718 Jun 03 12:10:41.721084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 403/826] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:10:41 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/ips => generated 147 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:43.044614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef25c523-8316-42b1-a158-db2ad3e4fde9"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:10:43.046019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:43.050176 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:43.050949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:43.056441 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:43.056940 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:43.058046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:43.058552 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:43.566164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ae191e6e-1d48-44ad-8cdf-8b2091b837d8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526700 Jun 03 12:10:43.566774 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 424/827] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:10:43 2022] POST /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:10:51.053901 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:51.054885 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:51.062155 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:51.062599 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:51.063405 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:51.063808 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:51.095733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9b46d698-52b1-4790-ae02-d3940dceb4ad tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Jun 03 12:10:51.096300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 404/828] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:10:51 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:10:51.106681 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:51.107256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:51.113983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:51.114431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:51.115180 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:51.115632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:51.144610 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-79705a89-df17-4c27-8933-bfa1b0b8c304 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/ef25c523-8316-42b1-a158-db2ad3e4fde9" status: 200 len: 194 microversion: 2.1 time: 0.042151 Jun 03 12:10:51.145200 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 425/829] 10.222.0.15 () {58 vars in 1412 bytes} [Fri Jun 3 12:10:51 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/ef25c523-8316-42b1-a158-db2ad3e4fde9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:52.464518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f49d4fde-b922-4688-bc52-98ffee168308"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:10:52.465576 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:52.471779 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:52.472225 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:52.472984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:52.473417 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:52.743293 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c4d72b45-cded-4f72-919d-fa07989276e8 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "POST /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283470 Jun 03 12:10:52.744008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 405/830] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:10:52 2022] POST /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:53.223259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:53.223804 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:53.230224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.230669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.231423 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.231882 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.254706 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-86059eb9-1249-4bd9-9801-b661b1f2bcdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/ips" status: 200 len: 150 microversion: 2.1 time: 0.035440 Jun 03 12:10:53.255262 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 426/831] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:10:53 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:53.267443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:10:53.268658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:53.275087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.275552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.276304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.276733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.354881 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Invalid volume: volume 1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 is already attached to instances: ccbc147a-97ca-458c-b45e-1df8bdf916df Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/os-volume_attachments HTTP/1.1 Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 74 Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:10:53.356735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {"volumeAttachment": {"volumeId": "1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42"}} Jun 03 12:10:53.358854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Invalid volume: volume 1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 is already attached to instances: ccbc147a-97ca-458c-b45e-1df8bdf916df Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'server_id': 'd1394f44-138a-4b23-b949-b6537e47c60f', 'body': {'volumeAttachment': {'volumeId': '1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42'}}} Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 is already attached to instances: ccbc147a-97ca-458c-b45e-1df8bdf916df Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:53.360169 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 is already attached to instances: ccbc147a-97ca-458c-b45e-1df8bdf916df Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:10:53.361807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 is already attached to instances: ccbc147a-97ca-458c-b45e-1df8bdf916df Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 400 to user: Invalid volume: volume 1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 is already attached to instances: ccbc147a-97ca-458c-b45e-1df8bdf916df {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a6c6b1e4-4c17-442e-b89a-349db9eb2c20 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096200 Jun 03 12:10:53.363408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 406/832] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:10:53 2022] POST /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:10:53.367050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:53.367571 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:53.373704 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.374749 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.375625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.376084 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.401578 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:10:53.483290 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-78751862-a996-49a1-9b35-b9c7edbec93d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 204 len: 0 microversion: 2.1 time: 0.119592 Jun 03 12:10:53.484110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 427/833] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:10:53 2022] DELETE /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:10:53.492935 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:53.493487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:53.500790 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.501232 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.501992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:53.502427 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:53.644974 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:53.653214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9e4ce483-2790-40c9-9bee-4698a04648a6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1682 microversion: 2.1 time: 0.164803 Jun 03 12:10:53.653782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 407/834] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:53 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:54.672768 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:54.673449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:54.679885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:54.680334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:54.681086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:54.681515 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:54.818093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:54.825954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d1a7feb7-9007-4f33-a284-803ff284a910 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1682 microversion: 2.1 time: 0.158901 Jun 03 12:10:54.826585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 428/835] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:54 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:55.844195 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:55.844878 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:55.851175 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:55.851645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:55.852408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:55.852846 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:55.943803 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:10:55.953659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9a6a42d0-f8ae-4808-b840-ebe4ba6afdaf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 200 len: 1614 microversion: 2.1 time: 0.114066 Jun 03 12:10:55.954945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 408/836] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:55 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:10:56.221540 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-fabc8367-a67d-4251-83e2-494ba2901040 req-8fa41c4e-ccaa-44fc-9eab-38386e551842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1394f44-138a-4b23-b949-b6537e47c60f", "name": "network-vif-deleted", "tag": "bf0c3f30-335b-468b-9d30-80212798fa55"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:10:56.232990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-fabc8367-a67d-4251-83e2-494ba2901040 req-8fa41c4e-ccaa-44fc-9eab-38386e551842 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:56.233516 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-fabc8367-a67d-4251-83e2-494ba2901040 req-8fa41c4e-ccaa-44fc-9eab-38386e551842 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:56.251799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-fabc8367-a67d-4251-83e2-494ba2901040 req-8fa41c4e-ccaa-44fc-9eab-38386e551842 service nova] Creating event network-vif-deleted:bf0c3f30-335b-468b-9d30-80212798fa55 for instance d1394f44-138a-4b23-b949-b6537e47c60f on hv-cinder-84457 Jun 03 12:10:56.257015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-fabc8367-a67d-4251-83e2-494ba2901040 req-8fa41c4e-ccaa-44fc-9eab-38386e551842 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042245 Jun 03 12:10:56.257710 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 429/837] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:56.971005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:56.971659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:56.978402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:56.978842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:56.979633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:56.980068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:56.994650 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f HTTP/1.1 Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:10:56.995940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:10:56.997453 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'd1394f44-138a-4b23-b949-b6537e47c60f'} Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:10:56.998235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:10:56.999783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:10:57.002595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:10:57.002595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5d13de53-113b-4613-ad2c-2e91693dba58 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jun 03 12:10:57.002595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 409/838] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:10:56 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:10:57.007834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b49a6bc5-7208-45b2-8e4f-50106bde2b34 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '.version_select at 0x7f19c5ee1c10>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:57.029519 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b49a6bc5-7208-45b2-8e4f-50106bde2b34 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088134802" status: 202 len: 0 microversion: 2.1 time: 0.026292 Jun 03 12:10:57.030252 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 430/839] 10.222.0.15 () {58 vars in 1220 bytes} [Fri Jun 3 12:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088134802 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:10:57.721092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:57.721686 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:57.728281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:57.728733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:57.729511 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:57.729947 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:57.816201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lazy-loading 'services' on Instance uuid ccbc147a-97ca-458c-b45e-1df8bdf916df {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:10:57.894433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3f593624-dae3-4c52-88e4-79dacdffeb60 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments/1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42" status: 202 len: 0 microversion: 2.1 time: 0.178566 Jun 03 12:10:57.895087 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 410/840] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:10:57 2022] DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments/1f3ea9f3-fdb3-4e99-aa6a-97b9afb93d42 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:10:57.904898 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:57.906069 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:57.913930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:57.914276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:57.915082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:57.915569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:57.950161 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7008c6a3-060a-44eb-b90f-c14f9c47852b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049465 Jun 03 12:10:57.950719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 431/841] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:10:57 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:10:58.963618 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:10:58.964669 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:10:58.973430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:58.973915 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:58.974695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:10:58.975138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:10:59.003366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-44ca12ce-ecc4-4c39-8dee-39b4e3689917 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Jun 03 12:10:59.003951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 411/842] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:10:58 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:00.015053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:00.015996 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:00.022683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:00.023122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:00.024184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:00.024611 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:00.054828 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f0748133-218d-46a9-9f22-b33c50f89491 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Jun 03 12:11:00.055385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 432/843] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:11:00 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:01.066906 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:01.067960 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:01.074534 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.074983 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.075803 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.076243 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.114608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-50b4975f-3dd2-4f98-81ea-4bcd901b8d2c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051715 Jun 03 12:11:01.115199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 412/844] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:11:01 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:01.334853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:01.335815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:01.342267 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.342810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.344121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.344567 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.373491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-97f12f04-1d15-4bfc-a998-08f3f4c45605 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042488 Jun 03 12:11:01.374113 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 433/845] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:11:01 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:01.547264 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:01.547793 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:01.554525 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.554997 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.555805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.556248 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.587601 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-555819e8-36c2-4ff9-b51c-540c0c3bc31c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/ef25c523-8316-42b1-a158-db2ad3e4fde9" status: 200 len: 194 microversion: 2.1 time: 0.044297 Jun 03 12:11:01.588198 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 413/846] 10.222.0.15 () {58 vars in 1412 bytes} [Fri Jun 3 12:11:01 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/ef25c523-8316-42b1-a158-db2ad3e4fde9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:01.598150 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:01.598622 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:01.604678 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.605116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.605861 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:01.606287 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:01.686016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lazy-loading 'services' on Instance uuid b56d73ac-456c-400f-97ee-5b205eab2aa5 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:11:01.759057 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-92269565-1c68-484d-aad3-e9c260aad6ea tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/ef25c523-8316-42b1-a158-db2ad3e4fde9" status: 202 len: 0 microversion: 2.1 time: 0.164590 Jun 03 12:11:01.759677 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 434/847] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:11:01 2022] DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/ef25c523-8316-42b1-a158-db2ad3e4fde9 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:11:02.126971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:02.127851 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:02.134199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:02.134641 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:02.135392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:02.135851 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:02.164159 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e27ccc81-90bf-4812-a655-fd3aed58b500 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041862 Jun 03 12:11:02.164695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 414/848] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:11:02 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:11:02.221226 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:02.221807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:02.228035 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:02.228481 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:02.229322 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:02.229755 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:02.255457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:11:02.335346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-dde6c08a-3b83-4738-bc3d-7aa7b5a4fca6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 204 len: 0 microversion: 2.1 time: 0.118491 Jun 03 12:11:02.336190 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 435/849] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:11:02 2022] DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:11:02.345915 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:02.346517 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:02.352548 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:02.352987 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:02.353734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:02.354168 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:02.489371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:02.497146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d0b272a9-144d-42ce-854f-f1b58b864d67 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1681 microversion: 2.1 time: 0.155217 Jun 03 12:11:02.497710 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 415/850] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:02 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:11:03.515549 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:03.516298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:03.523269 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:03.523752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:03.524779 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:03.525205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:03.661626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:03.669891 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-168a4346-9f57-43d0-89fd-8f58f15e58ce tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1681 microversion: 2.1 time: 0.158480 Jun 03 12:11:03.670506 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 436/851] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:03 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:04.688124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:04.688818 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:04.695690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:04.696266 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:04.697112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:04.697621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:04.918608 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:04.926589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-caf3ddac-b13f-4fef-b5f6-d5c49b26530a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1681 microversion: 2.1 time: 0.243080 Jun 03 12:11:04.927382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 416/852] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:04 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:04.992439 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:04.993029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:05.000775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.001331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.002184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.002693 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.007026 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:05.036053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c3f170a4-d787-4507-88fc-76464a69a7f6 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/f49d4fde-b922-4688-bc52-98ffee168308" status: 200 len: 194 microversion: 2.1 time: 0.047560 Jun 03 12:11:05.036676 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 437/853] 10.222.0.15 () {58 vars in 1412 bytes} [Fri Jun 3 12:11:04 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/f49d4fde-b922-4688-bc52-98ffee168308 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:05.047140 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:05.047668 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:05.054392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.054757 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.055564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.056004 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.142403 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lazy-loading 'services' on Instance uuid b56d73ac-456c-400f-97ee-5b205eab2aa5 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:11:05.207207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:05.220288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf543de7-407c-445a-a2ad-2e11f4f75a10 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/f49d4fde-b922-4688-bc52-98ffee168308" status: 202 len: 0 microversion: 2.1 time: 0.177597 Jun 03 12:11:05.220903 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 417/854] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:11:05 2022] DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments/f49d4fde-b922-4688-bc52-98ffee168308 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:11:05.716580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-32e2f140-17a7-4374-99ef-ee13c2516f6e req-7f05e373-a7fc-47a0-8a3a-8289f187bb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbc147a-97ca-458c-b45e-1df8bdf916df", "name": "network-vif-deleted", "tag": "26fc72b3-64e6-4686-ba10-4b5b74149d05"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:05.726222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-32e2f140-17a7-4374-99ef-ee13c2516f6e req-7f05e373-a7fc-47a0-8a3a-8289f187bb13 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.726586 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-32e2f140-17a7-4374-99ef-ee13c2516f6e req-7f05e373-a7fc-47a0-8a3a-8289f187bb13 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.739126 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-32e2f140-17a7-4374-99ef-ee13c2516f6e req-7f05e373-a7fc-47a0-8a3a-8289f187bb13 service nova] Creating event network-vif-deleted:26fc72b3-64e6-4686-ba10-4b5b74149d05 for instance ccbc147a-97ca-458c-b45e-1df8bdf916df on hv-cinder-84457 Jun 03 12:11:05.745162 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-32e2f140-17a7-4374-99ef-ee13c2516f6e req-7f05e373-a7fc-47a0-8a3a-8289f187bb13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 Jun 03 12:11:05.746032 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 438/855] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:11:05.944425 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:05.945898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:05.958729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.959443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.960251 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.960692 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.995568 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:05.996023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:05.996478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lazy-loading 'fault' on Instance uuid ccbc147a-97ca-458c-b45e-1df8bdf916df {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:11:06.042659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:06.051034 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-41b425a6-7098-44bb-8f02-62f9920c4e95 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 200 len: 1330 microversion: 2.1 time: 0.110725 Jun 03 12:11:06.051629 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 418/856] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:05 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:06.400364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:06.401371 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:06.408059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.408533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.409318 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.409733 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.444632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8c63c7e4-3384-41a6-b65a-0aa191846e7d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049142 Jun 03 12:11:06.445236 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 439/857] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:11:06 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:11:06.555796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:06.556801 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:06.563700 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.564151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.564931 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.565567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.597466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e569484b-c08b-4fc9-8936-6a02d29c7b9b tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045715 Jun 03 12:11:06.598022 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 419/858] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:11:06 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:11:06.659795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:06.660312 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:06.666636 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.667091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.667896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.668334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.697222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Going to try to terminate instance {{(pid=117617) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:11:06.779037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6c8e9163-b8f1-47d2-88ed-c39b1c019ae2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 204 len: 0 microversion: 2.1 time: 0.123496 Jun 03 12:11:06.779663 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 440/859] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:11:06 2022] DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:11:06.788392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:06.789003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:06.794990 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.795435 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.796882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:06.797312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:06.928850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:06.936547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dcd05609-451d-4a33-b390-815373945fb4 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1675 microversion: 2.1 time: 0.152008 Jun 03 12:11:06.937102 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 420/860] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:06 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:07.068842 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:07.069514 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:07.075605 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:07.076060 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:07.076846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:07.077796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:07.091212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df HTTP/1.1 Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:11:07.093554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:11:07.095080 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'ccbc147a-97ca-458c-b45e-1df8bdf916df'} Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:11:07.096028 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:11:07.097449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:07.098695 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:11:07.098695 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a64e8488-c17d-42c5-bf7d-1bdd87052443 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 404 len: 111 microversion: 2.1 time: 0.030557 Jun 03 12:11:07.098695 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 441/861] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:07 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:11:07.103965 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9744c923-6f52-4f1e-87f7-3bf4c2144f8d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '.version_select at 0x7f19c638b700>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:07.121185 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9744c923-6f52-4f1e-87f7-3bf4c2144f8d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323344712" status: 202 len: 0 microversion: 2.1 time: 0.020976 Jun 03 12:11:07.121732 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 421/862] 10.222.0.15 () {58 vars in 1217 bytes} [Fri Jun 3 12:11:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323344712 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:11:07.953728 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:07.954986 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:07.961799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:07.962250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:07.963025 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:07.963471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:07.986973 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-87c2b568-17df-4444-86b2-d63d08342ad6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: .version_select at 0x7f19c5ae2820>, body: {"keypair": {"name": "tempest-keypair-1913337731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP5LPmbzyzyL0rpp+wuXofItZhOQ5g7a3KT3H9Cf3lyvV4pIc3zeG3bdqF9AK7oZEaLXYeaD8FhweJK9How7tFwuLENmX9PubUqSSeoggiyAT74/lywy2kJdOZ/7LnCYg=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:08.001358 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-87c2b568-17df-4444-86b2-d63d08342ad6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:11:08.005227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-87c2b568-17df-4444-86b2-d63d08342ad6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:11:08.030936 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-87c2b568-17df-4444-86b2-d63d08342ad6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048146 Jun 03 12:11:08.031774 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 422/863] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:11:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:11:08.145831 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:08.153796 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5d086687-95c6-428c-8ca3-ab363854ad20 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1675 microversion: 2.1 time: 0.203785 Jun 03 12:11:08.154155 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 442/864] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:07 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:09.177055 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:09.178122 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:09.188481 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:09.189238 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:09.190487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:09.190989 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:09.525429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:09.537121 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f3a624f7-1bad-452e-a582-f6cdc65dd389 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1675 microversion: 2.1 time: 0.368506 Jun 03 12:11:09.537828 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 423/865] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:09 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1675 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:09.837650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-636908012", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d93d3bc-8776-4cd1-bb83-66977617e90d"}], "security_groups": [{"name": "tempest-securitygroup--1243650956"}], "key_name": "tempest-keypair-1913337731", "user_data": "}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:09.963147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] validate_networks() for [('5d93d3bc-8776-4cd1-bb83-66977617e90d', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:11:10.202286 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-5b2c5d8d-b9e7-4fd0-89eb-610cdb6e9252 req-ab026b92-6ef8-4084-aed8-9c547479168e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56d73ac-456c-400f-97ee-5b205eab2aa5", "name": "network-vif-deleted", "tag": "d49f1b59-eee0-4ff4-92db-e5781200d1ef"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:10.213435 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5b2c5d8d-b9e7-4fd0-89eb-610cdb6e9252 req-ab026b92-6ef8-4084-aed8-9c547479168e service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:10.213895 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5b2c5d8d-b9e7-4fd0-89eb-610cdb6e9252 req-ab026b92-6ef8-4084-aed8-9c547479168e service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:10.226806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-5b2c5d8d-b9e7-4fd0-89eb-610cdb6e9252 req-ab026b92-6ef8-4084-aed8-9c547479168e service nova] Creating event network-vif-deleted:d49f1b59-eee0-4ff4-92db-e5781200d1ef for instance b56d73ac-456c-400f-97ee-5b205eab2aa5 on hv-cinder-84457 Jun 03 12:11:10.241263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-5b2c5d8d-b9e7-4fd0-89eb-610cdb6e9252 req-ab026b92-6ef8-4084-aed8-9c547479168e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042728 Jun 03 12:11:10.242049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 424/866] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:11:10.464905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:11:10.465321 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:11:10.465801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:11:10.466211 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:11:10.466614 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:11:10.479885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:10.480327 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:10.481115 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:10.481545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:10.498052 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:11:10.502581 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:11:10.515101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:11:10.517363 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:11:10.555624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:10.556337 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:10.564653 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:10.565198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2fa5cb0e-2873-429c-9df0-c34149dadaa4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.732053 Jun 03 12:11:10.565557 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:10.570902 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 443/867] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:11:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:11:10.571865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:10.572504 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:10.576653 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c23b509a-de0e-46bd-988f-3695b5da2cdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:10.577983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c23b509a-de0e-46bd-988f-3695b5da2cdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:10.613443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:10.614889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:10.615606 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lazy-loading 'fault' on Instance uuid b56d73ac-456c-400f-97ee-5b205eab2aa5 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:11:10.644481 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c23b509a-de0e-46bd-988f-3695b5da2cdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:10.656052 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c23b509a-de0e-46bd-988f-3695b5da2cdc tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1241 microversion: 2.1 time: 0.083548 Jun 03 12:11:10.665983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 444/868] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:10 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:10.694636 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76db57106a684c7592dc8cba4bc0a9d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db41a74c9582485b9def49d558170121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:10.706723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5136efd1-e6c8-4fd4-93c7-f0bcd644444d tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 200 len: 1327 microversion: 2.1 time: 0.155707 Jun 03 12:11:10.707555 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 425/869] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:10 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 1327 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:11:11.673100 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:11.674284 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:11.681732 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:11.682472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:11.683209 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:11.683672 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:11.728196 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:11.729873 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:11.733689 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:11.739908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:11.740783 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:11.741745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:11.742387 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:11.755016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:11.763379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] HTTP exception thrown: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:11.763568 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-389f4ec1-ceff-4d95-bb88-61390e2e63af tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1311 microversion: 2.1 time: 0.094432 Jun 03 12:11:11.765237 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 445/870] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:11 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Request method failure captured: Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 HTTP/1.1 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfjWXbs3hOs0SNZRniOetm5MnuMcPt8P6PI0AwxgDaULHFxWJ68QC487LcvSFa8IdWojgebFTUk4SC7yROrhRHuha1t8CuS7SX4SCqI1KJ6IdkD1bPmEbuaREnbeFToWTjJ0Jov8J1yU4LL3dIYBU-_h8R8v-pO7C_rjeKTwrIuUq44 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:11:11.766250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db41a74c9582485b9def49d558170121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db41a74c9582485b9def49d558170121"}]}] Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 76db57106a684c7592dc8cba4bc0a9d7 Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:11.767613 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'b56d73ac-456c-400f-97ee-5b205eab2aa5'} Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:11:11.768363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:11.770300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:11.771865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Returning 404 to user: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:11:11.771865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-024f8019-03a5-42f8-ae8c-4eb4f2fbb837 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 404 len: 111 microversion: 2.1 time: 0.047106 Jun 03 12:11:11.771865 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 426/871] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:11 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 12:11:11.776716 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-defbe422-7b7e-4610-a3b4-dd5234d23454 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '.version_select at 0x7f19c5a40ca0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:11.794029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-defbe422-7b7e-4610-a3b4-dd5234d23454 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878601809" status: 202 len: 0 microversion: 2.1 time: 0.021255 Jun 03 12:11:11.794582 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 446/872] 10.222.0.15 () {58 vars in 1220 bytes} [Fri Jun 3 12:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878601809 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:11:12.784328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:12.785139 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:12.792374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:12.793839 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:12.794635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:12.795081 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:12.996385 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:13.004751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-19fc5029-95a2-43d1-bdef-ddfb7494f4d4 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.224815 Jun 03 12:11:13.005359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 427/873] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:12 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:13.346935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-e5cb557c-6fee-4b05-83a3-f971e6893d2e req-6196f04a-ddfb-4188-8014-94ca4d9be944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a78daf-c3d9-4d83-9c4d-3a4e184d45f3", "tag": "e250f690-2907-48e3-aed0-5f2131f50904"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:13.353298 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:13.367013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-e5cb557c-6fee-4b05-83a3-f971e6893d2e req-6196f04a-ddfb-4188-8014-94ca4d9be944 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:13.367825 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-e5cb557c-6fee-4b05-83a3-f971e6893d2e req-6196f04a-ddfb-4188-8014-94ca4d9be944 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:13.383554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-e5cb557c-6fee-4b05-83a3-f971e6893d2e req-6196f04a-ddfb-4188-8014-94ca4d9be944 service nova] Creating event network-changed:e250f690-2907-48e3-aed0-5f2131f50904 for instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 on hv-cinder-84457 Jun 03 12:11:13.392943 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-e5cb557c-6fee-4b05-83a3-f971e6893d2e req-6196f04a-ddfb-4188-8014-94ca4d9be944 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054606 Jun 03 12:11:13.394038 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 447/874] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:14.021658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:14.022413 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:14.030773 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:14.031227 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:14.032050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:14.032485 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:14.170849 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:14.178356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-396d4a48-597f-4342-9b77-b574376ee698 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.160943 Jun 03 12:11:14.178912 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 428/875] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:14 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:14.771099 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:14.771740 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:14.779452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:14.779953 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:14.780738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:14.781177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:14.796151 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] HTTP exception thrown: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Request method failure captured: Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 HTTP/1.1 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfjWXbs3hOs0SNZRniOetm5MnuMcPt8P6PI0AwxgDaULHFxWJ68QC487LcvSFa8IdWojgebFTUk4SC7yROrhRHuha1t8CuS7SX4SCqI1KJ6IdkD1bPmEbuaREnbeFToWTjJ0Jov8J1yU4LL3dIYBU-_h8R8v-pO7C_rjeKTwrIuUq44 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:11:14.797834 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db41a74c9582485b9def49d558170121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db41a74c9582485b9def49d558170121"}]}] Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 76db57106a684c7592dc8cba4bc0a9d7 Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.799455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'b56d73ac-456c-400f-97ee-5b205eab2aa5'} Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:11:14.800365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.801801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.803281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Returning 404 to user: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:11:14.803281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1ec71006-736f-4cea-b6e1-c766f50d1769 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 404 len: 111 microversion: 2.1 time: 0.033076 Jun 03 12:11:14.803281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 448/876] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:11:14 2022] DELETE /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:11:14.807884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:14.808491 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: b56d73ac-456c-400f-97ee-5b205eab2aa5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:14.815229 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:14.815729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:14.816493 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:14.816923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:14.833216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] HTTP exception thrown: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Request method failure captured: Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 HTTP/1.1 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfjWXbs3hOs0SNZRniOetm5MnuMcPt8P6PI0AwxgDaULHFxWJ68QC487LcvSFa8IdWojgebFTUk4SC7yROrhRHuha1t8CuS7SX4SCqI1KJ6IdkD1bPmEbuaREnbeFToWTjJ0Jov8J1yU4LL3dIYBU-_h8R8v-pO7C_rjeKTwrIuUq44 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:11:14.834740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db41a74c9582485b9def49d558170121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db41a74c9582485b9def49d558170121"}]}] Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 76db57106a684c7592dc8cba4bc0a9d7 Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.836203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'b56d73ac-456c-400f-97ee-5b205eab2aa5'} Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:11:14.837067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. Jun 03 12:11:14.838559 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:14.839876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Returning 404 to user: Instance b56d73ac-456c-400f-97ee-5b205eab2aa5 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:11:14.839876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-76e71c13-4662-4bbb-b497-7247180f01a2 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5" status: 404 len: 111 microversion: 2.1 time: 0.032140 Jun 03 12:11:14.839876 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 429/877] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:14 2022] GET /compute/v2.1/servers/b56d73ac-456c-400f-97ee-5b205eab2aa5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 12:11:15.195376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:15.196007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:15.203100 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:15.203590 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:15.204362 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:15.204930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:15.347818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:15.355339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-74d1f839-6d11-4a3a-9cb8-5a0e5899e5bf tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.163809 Jun 03 12:11:15.355935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 449/878] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:15 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:15.979181 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:15.980264 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:15.988202 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:15.988633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:15.989430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:15.990202 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:16.005281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] HTTP exception thrown: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Request method failure captured: Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb HTTP/1.1 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfjWXbs3hOs0SNZRniOetm5MnuMcPt8P6PI0AwxgDaULHFxWJ68QC487LcvSFa8IdWojgebFTUk4SC7yROrhRHuha1t8CuS7SX4SCqI1KJ6IdkD1bPmEbuaREnbeFToWTjJ0Jov8J1yU4LL3dIYBU-_h8R8v-pO7C_rjeKTwrIuUq44 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:11:16.006850 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db41a74c9582485b9def49d558170121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db41a74c9582485b9def49d558170121"}]}] Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 76db57106a684c7592dc8cba4bc0a9d7 Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.008272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'd7dd2271-e4e4-4e18-b2e4-69993351fdfb'} Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:11:16.009019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.011207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.013673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Returning 404 to user: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:11:16.013673 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c202522a-0a25-49d5-beb7-5f4b032dfe90 tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 404 len: 111 microversion: 2.1 time: 0.033543 Jun 03 12:11:16.016791 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 430/879] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:11:15 2022] DELETE /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:11:16.021969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:16.022664 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] [instance: d7dd2271-e4e4-4e18-b2e4-69993351fdfb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:16.029697 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:16.030143 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:16.030917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:16.031350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:16.046715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] HTTP exception thrown: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Request method failure captured: Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb HTTP/1.1 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfjWXbs3hOs0SNZRniOetm5MnuMcPt8P6PI0AwxgDaULHFxWJ68QC487LcvSFa8IdWojgebFTUk4SC7yROrhRHuha1t8CuS7SX4SCqI1KJ6IdkD1bPmEbuaREnbeFToWTjJ0Jov8J1yU4LL3dIYBU-_h8R8v-pO7C_rjeKTwrIuUq44 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:11:16.048315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db41a74c9582485b9def49d558170121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db41a74c9582485b9def49d558170121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db41a74c9582485b9def49d558170121"}]}] Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: db41a74c9582485b9def49d558170121 Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1931547138 Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 76db57106a684c7592dc8cba4bc0a9d7 Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeTestJSON-1931547138-project Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.049937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'd7dd2271-e4e4-4e18-b2e4-69993351fdfb'} Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:11:16.050787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. Jun 03 12:11:16.052336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:11:16.053735 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] Returning 404 to user: Instance d7dd2271-e4e4-4e18-b2e4-69993351fdfb could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:11:16.053735 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cf9ed537-0a19-4285-9cfc-ae1221bffb8c tempest-AttachVolumeTestJSON-1931547138 tempest-AttachVolumeTestJSON-1931547138-project] 10.222.0.15 "GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jun 03 12:11:16.053735 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 450/880] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:16 2022] GET /compute/v2.1/servers/d7dd2271-e4e4-4e18-b2e4-69993351fdfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:11:16.372115 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:16.372729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:16.379848 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:16.380285 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:16.381249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:16.381687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:16.627580 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:16.637266 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-247ca76e-a28d-467a-8e37-ef76be405063 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.268930 Jun 03 12:11:16.637845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 431/881] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:16 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:17.654893 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:17.656155 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:17.663806 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:17.664555 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:17.665368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:17.665807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:17.911101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:17.917453 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2c1fffd7-c90f-45c5-a44f-25b7cd8ec71b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.266413 Jun 03 12:11:17.927302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 451/882] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:17 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:18.848946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-571d92db-0c79-469b-950e-5636b60af875 req-736e3bf0-d255-4d84-8f5a-9b8190911a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a78daf-c3d9-4d83-9c4d-3a4e184d45f3", "name": "network-vif-plugged", "status": "completed", "tag": "e250f690-2907-48e3-aed0-5f2131f50904"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:18.855364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:18.862392 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-571d92db-0c79-469b-950e-5636b60af875 req-736e3bf0-d255-4d84-8f5a-9b8190911a70 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:18.863381 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-571d92db-0c79-469b-950e-5636b60af875 req-736e3bf0-d255-4d84-8f5a-9b8190911a70 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:18.895952 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-571d92db-0c79-469b-950e-5636b60af875 req-736e3bf0-d255-4d84-8f5a-9b8190911a70 service nova] Creating event network-vif-plugged:e250f690-2907-48e3-aed0-5f2131f50904 for instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 on hv-cinder-84457 Jun 03 12:11:18.914400 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-571d92db-0c79-469b-950e-5636b60af875 req-736e3bf0-d255-4d84-8f5a-9b8190911a70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072201 Jun 03 12:11:18.915215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 432/883] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:18.935597 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:18.936780 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:18.944802 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:18.945355 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:18.946212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:18.946884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:19.253794 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:19.267309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-09da6d26-f5df-4ab5-9d02-776bc4bf6593 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.336650 Jun 03 12:11:19.278173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 452/884] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:18 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:20.286880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:20.287832 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:20.294711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:20.295168 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:20.296052 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:20.296499 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:20.448379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:20.456383 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9972ddc9-53d1-4825-b586-3084956a19c1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1367 microversion: 2.1 time: 0.173928 Jun 03 12:11:20.456950 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 433/885] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:20 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:21.473969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:21.474719 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:21.478537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:21.479224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=8 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:21.484281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:21.484517 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:21.485296 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:21.485748 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:21.633491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:11:21.642208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-28c5ba55-a211-4004-a9de-ce32cf8f1c10 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1558 microversion: 2.1 time: 0.172904 Jun 03 12:11:21.642788 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 453/886] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:11:21 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:11:21.658629 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:11:21.659172 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:11:21.665934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:21.666379 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:21.667148 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:21.667602 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:21.749892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-981c169c-0f64-4cbc-aadf-90a8c71cf772 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095147 Jun 03 12:11:21.751183 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 434/887] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:11:21 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:11:22.702528 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-59597095-993c-40aa-b0f4-1f68a8435d55 req-5c805ebf-8fff-43ef-a485-ebd05f2b6bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a78daf-c3d9-4d83-9c4d-3a4e184d45f3", "tag": "e250f690-2907-48e3-aed0-5f2131f50904"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:11:22.711348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-59597095-993c-40aa-b0f4-1f68a8435d55 req-5c805ebf-8fff-43ef-a485-ebd05f2b6bf4 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:11:22.711812 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-59597095-993c-40aa-b0f4-1f68a8435d55 req-5c805ebf-8fff-43ef-a485-ebd05f2b6bf4 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:11:22.727227 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-59597095-993c-40aa-b0f4-1f68a8435d55 req-5c805ebf-8fff-43ef-a485-ebd05f2b6bf4 service nova] Creating event network-changed:e250f690-2907-48e3-aed0-5f2131f50904 for instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 on hv-cinder-84457 Jun 03 12:11:22.732354 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-59597095-993c-40aa-b0f4-1f68a8435d55 req-5c805ebf-8fff-43ef-a485-ebd05f2b6bf4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Jun 03 12:11:22.732980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 454/888] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:12:12.527916 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=17 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:12.528740 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=72 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:12.533421 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-58618672", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1917680760", "security_groups": [{"name": "tempest-secgroup-smoke-972159627"}], "block_device_mapping_v2": [{"uuid": "e86e91aa-ab0c-4fe3-8a58-10154f9cb08f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1099c87b-fd5a-4442-acb6-6dd6fbd0317b"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:12:12.643707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] validate_networks() for [('1099c87b-fd5a-4442-acb6-6dd6fbd0317b', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:12:13.119012 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:12:13.119438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:12:13.119940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:12:13.120356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:12:13.120765 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:12:13.131094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:13.131634 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:13.132472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:13.132909 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:13.150562 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for project adff32783b7a479d89e34cd1e5a118d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:12:13.154531 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Getting quotas for user 79c5b9ec7d2248918e884cd01adb84c6 and project adff32783b7a479d89e34cd1e5a118d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:12:13.213105 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:12:13.215173 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e86e91aa-ab0c-4fe3-8a58-10154f9cb08f',volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:12:13.344913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-138ffc4c-bed4-47aa-9f30-df0e85658049 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818544 Jun 03 12:12:13.345564 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 435/889] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:12:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:12:13.353772 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=15 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:13.354600 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:13.359908 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-462242b3-d625-4d3c-b87e-eecac0ed5c96 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:13.360635 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-462242b3-d625-4d3c-b87e-eecac0ed5c96 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:13.421601 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-462242b3-d625-4d3c-b87e-eecac0ed5c96 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:13.428637 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-462242b3-d625-4d3c-b87e-eecac0ed5c96 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1093 microversion: 2.1 time: 0.076938 Jun 03 12:12:13.429379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 455/890] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:13 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:12:14.445550 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:14.446145 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:14.452377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:14.453328 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:14.454098 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:14.454533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:14.518964 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:14.527246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e1a97c4e-25fd-4551-901d-2545cd8f23bb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1191 microversion: 2.1 time: 0.085932 Jun 03 12:12:14.527925 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 436/891] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:14 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:15.545916 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:15.547173 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:15.554822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:15.555267 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:15.556066 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:15.556531 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:15.704744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:15.712950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4e2e96cf-6986-4e2a-8c4f-4c6b88a20517 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.171020 Jun 03 12:12:15.713529 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 456/892] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:15 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:12:16.730201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:16.730816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:16.737364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:16.737809 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:16.738566 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:16.739003 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:16.872749 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:16.880452 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7699ddd2-5671-4889-bad2-7de6fe160920 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.154138 Jun 03 12:12:16.881020 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 437/893] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:16 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:17.897111 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:17.897771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:17.904781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:17.905224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:17.906015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:17.906446 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:18.041564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:18.049163 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e58d7ea0-2341-4646-ab1b-1d26ebe85b43 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.156000 Jun 03 12:12:18.049725 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 457/894] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:17 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:19.065879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:19.066487 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:19.072994 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:19.073435 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:19.074193 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:19.074623 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:19.205621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:19.213050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b5a5c3ba-1bc4-488a-ac48-3687e966b40c tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.151626 Jun 03 12:12:19.213605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 438/895] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:19 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:19.992055 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-0cf5c775-c640-484c-ac74-2a7bc80639de req-c1f6d54b-99d0-4caa-b863-3e768fdab5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6bed96-0a2e-4712-bbde-82b4e42da6e9", "tag": "2402dcad-a071-4205-a599-0096541544f3"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:12:20.003132 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-0cf5c775-c640-484c-ac74-2a7bc80639de req-c1f6d54b-99d0-4caa-b863-3e768fdab5f6 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:20.003627 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-0cf5c775-c640-484c-ac74-2a7bc80639de req-c1f6d54b-99d0-4caa-b863-3e768fdab5f6 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:20.018771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-0cf5c775-c640-484c-ac74-2a7bc80639de req-c1f6d54b-99d0-4caa-b863-3e768fdab5f6 service nova] Creating event network-changed:2402dcad-a071-4205-a599-0096541544f3 for instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 on hv-cinder-84457 Jun 03 12:12:20.027542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-0cf5c775-c640-484c-ac74-2a7bc80639de req-c1f6d54b-99d0-4caa-b863-3e768fdab5f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041253 Jun 03 12:12:20.028771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 458/896] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:12:20.229881 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:20.230435 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:20.237694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:20.238149 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:20.238927 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:20.239366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:20.476445 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:20.486037 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3f9d6ec1-221b-4926-88cd-d9f1f7e821ee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.260148 Jun 03 12:12:20.486693 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 439/897] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:20 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:21.502724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:21.503411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:21.510504 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:21.510938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:21.511717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:21.512146 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:21.647591 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:21.655655 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b0df46d5-5cc7-46aa-98e4-0d77c93bca86 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.157107 Jun 03 12:12:21.656219 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 459/898] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:21 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:22.672723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:22.673330 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:22.679476 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:22.679955 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:22.680763 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:22.681135 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:22.817598 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:22.825325 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-91b2c4b9-4ca0-4b7a-b09d-323e89e0df50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.156585 Jun 03 12:12:22.825912 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 440/899] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:22 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:23.842101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:23.842707 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:23.845935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:23.851795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:23.852250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:23.853045 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:23.853482 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:23.988468 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:23.996215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-555c3090-6609-4cfb-9215-3174417a4941 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.157984 Jun 03 12:12:23.996787 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 460/900] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:23 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:25.013364 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:25.013971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:25.016199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:25.017068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:25.024257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:25.024971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:25.025754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:25.026491 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:25.165873 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:25.174062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b881be98-4675-4826-ae09-4f5889f88b08 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.164645 Jun 03 12:12:25.174864 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 441/901] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:25 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:26.191521 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:26.192160 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:26.198820 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:26.199267 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:26.200059 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:26.200492 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:26.340837 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:26.350097 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6f179dcc-4320-45cc-91c7-911acec45dee tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.163080 Jun 03 12:12:26.350625 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 461/902] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:26 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:27.367005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:27.367695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:27.374934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:27.375398 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:27.376249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:27.376720 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:27.511146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:27.520767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f0a28cc9-0c2f-4703-aa48-26a66f3012e2 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.157543 Jun 03 12:12:27.521503 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 442/903] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:27 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:28.537971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:28.538500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:28.544885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:28.545339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:28.546103 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:28.547093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:28.692934 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:28.703348 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-094bbac4-d3df-4b87-bac7-fa59fcfd8ad6 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.168437 Jun 03 12:12:28.703964 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 462/904] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:28 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:29.721096 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:29.721695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:29.728230 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:29.728780 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:29.729483 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:29.729930 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:29.864536 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:29.872120 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9aa10a5d-1d19-424d-92e6-203530c80af5 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.154919 Jun 03 12:12:29.872684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 443/905] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:29 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:30.888692 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:30.889323 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:30.897340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:30.897795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:30.898585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:30.899018 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:31.031923 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:31.039205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e73d4e46-d2e8-4959-b942-a366b296e790 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.154350 Jun 03 12:12:31.039781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 463/906] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:30 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:32.056518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:32.057170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:32.064466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:32.064847 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:32.065615 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:32.066050 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:32.202263 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:32.209733 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-680e53fb-daf5-41f1-8512-32322acc03cb tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.157137 Jun 03 12:12:32.210283 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 444/907] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:32 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:33.214361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-356265d5-c23e-4512-9cc3-830fbb1ec233 req-3ebb856e-7525-4029-8cd6-3aeae68a1fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6bed96-0a2e-4712-bbde-82b4e42da6e9", "name": "network-vif-plugged", "status": "completed", "tag": "2402dcad-a071-4205-a599-0096541544f3"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:12:33.225259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-356265d5-c23e-4512-9cc3-830fbb1ec233 req-3ebb856e-7525-4029-8cd6-3aeae68a1fd1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:33.226029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-356265d5-c23e-4512-9cc3-830fbb1ec233 req-3ebb856e-7525-4029-8cd6-3aeae68a1fd1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:33.227892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:33.229206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:33.236415 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:33.236864 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:33.237640 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:33.238078 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:33.243085 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-356265d5-c23e-4512-9cc3-830fbb1ec233 req-3ebb856e-7525-4029-8cd6-3aeae68a1fd1 service nova] Creating event network-vif-plugged:2402dcad-a071-4205-a599-0096541544f3 for instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 on hv-cinder-84457 Jun 03 12:12:33.248474 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-356265d5-c23e-4512-9cc3-830fbb1ec233 req-3ebb856e-7525-4029-8cd6-3aeae68a1fd1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037965 Jun 03 12:12:33.249387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 464/908] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:12:33.378279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:33.386123 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b790bdc4-bf9d-4e31-9202-a10ee2ebaa33 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.161983 Jun 03 12:12:33.386691 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 445/909] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:33 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:12:34.406193 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:34.407067 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:34.413738 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:34.414183 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:34.414951 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:34.415381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:34.560668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:34.570530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f3dbc2ac-bc34-4fba-b05f-824bc5b4aa74 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1264 microversion: 2.1 time: 0.169616 Jun 03 12:12:34.571263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 465/910] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:34 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:35.589478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:35.590116 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:35.597728 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:35.598179 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:35.598944 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:35.599384 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:35.735600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:35.745112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-35bea668-01bb-4ccb-8e1b-b6d18eaec722 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1451 microversion: 2.1 time: 0.159111 Jun 03 12:12:35.747705 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 446/911] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:35 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:35.763938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:12:35.764546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:12:35.771626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:35.771981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:35.772729 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:35.773155 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:35.909458 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:12:35.919172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3d2ea195-4db2-4e37-9fca-dde4db459b50 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1451 microversion: 2.1 time: 0.158803 Jun 03 12:12:35.919860 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 466/912] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:12:35 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:12:37.943425 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-bd20fdd5-32d3-48c6-84c0-94c21f4202e7 req-1da9bd3b-1f3b-4f2c-b9b3-b20b2facf72a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6bed96-0a2e-4712-bbde-82b4e42da6e9", "tag": "2402dcad-a071-4205-a599-0096541544f3"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:12:37.952197 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bd20fdd5-32d3-48c6-84c0-94c21f4202e7 req-1da9bd3b-1f3b-4f2c-b9b3-b20b2facf72a service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:12:37.952648 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bd20fdd5-32d3-48c6-84c0-94c21f4202e7 req-1da9bd3b-1f3b-4f2c-b9b3-b20b2facf72a service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:12:37.963306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-bd20fdd5-32d3-48c6-84c0-94c21f4202e7 req-1da9bd3b-1f3b-4f2c-b9b3-b20b2facf72a service nova] Creating event network-changed:2402dcad-a071-4205-a599-0096541544f3 for instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 on hv-cinder-84457 Jun 03 12:12:37.968390 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-bd20fdd5-32d3-48c6-84c0-94c21f4202e7 req-1da9bd3b-1f3b-4f2c-b9b3-b20b2facf72a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028577 Jun 03 12:12:37.968919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 447/913] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:06.558287 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1694381283", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "networks": [{"uuid": "9845895d-3584-4a6e-a1fc-e601ae378637"}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:06.565244 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=26 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:06.566081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=58 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:06.610302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] validate_networks() for [('9845895d-3584-4a6e-a1fc-e601ae378637', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:13:06.947492 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:13:06.947946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:13:06.948472 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:13:06.948887 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:13:06.949320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:13:06.958645 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:06.959179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:06.960024 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:06.960459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:06.977928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Getting quotas for project 4aec940c9f514bd9923ad6d815618e44. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:13:06.981717 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Getting quotas for user 4c59e1a01e9d4e3da0ea941b97cdab2c and project 4aec940c9f514bd9923ad6d815618e44. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:13:06.992417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:13:06.994640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:13:07.039821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0de6c14d-5566-4dc5-8e4f-a10cffb8580d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485489 Jun 03 12:13:07.040467 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 467/914] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 12:13:07.049083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:07.049919 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=70 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:07.055651 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d8cb59ab-e06f-42e8-9734-5704dc4bf481 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:07.056359 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d8cb59ab-e06f-42e8-9734-5704dc4bf481 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:07.111545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d8cb59ab-e06f-42e8-9734-5704dc4bf481 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:07.118290 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d8cb59ab-e06f-42e8-9734-5704dc4bf481 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1219 microversion: 2.1 time: 0.071586 Jun 03 12:13:07.118908 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 448/915] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:07 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:08.135762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:08.136464 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:08.142602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:08.143045 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:08.143872 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:08.144304 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:08.209684 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:08.223403 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-57777391-d0b1-4db5-803f-d89bbfafea58 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1279 microversion: 2.1 time: 0.091508 Jun 03 12:13:08.224310 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 468/916] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:08 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:09.241722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:09.242335 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:09.249469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:09.249913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:09.250665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:09.251094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:09.454431 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:09.461939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-020a2038-56af-4290-8d99-c11c17fd1a8f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.224052 Jun 03 12:13:09.462502 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 449/917] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:09 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:09.672316 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-e31bac37-cbeb-45a2-94e8-74bd2174f35c req-830f3868-6671-44f3-abdd-0c10878e12fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dac7a24-2d7f-4466-87e8-3a67fcfe65af", "tag": "10c9bd2f-8ecb-4131-81d2-de3518b0b238"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:09.682131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-e31bac37-cbeb-45a2-94e8-74bd2174f35c req-830f3868-6671-44f3-abdd-0c10878e12fe service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:09.682676 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-e31bac37-cbeb-45a2-94e8-74bd2174f35c req-830f3868-6671-44f3-abdd-0c10878e12fe service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:09.694669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-e31bac37-cbeb-45a2-94e8-74bd2174f35c req-830f3868-6671-44f3-abdd-0c10878e12fe service nova] Creating event network-changed:10c9bd2f-8ecb-4131-81d2-de3518b0b238 for instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af on hv-cinder-84457 Jun 03 12:13:09.699340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-e31bac37-cbeb-45a2-94e8-74bd2174f35c req-830f3868-6671-44f3-abdd-0c10878e12fe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031515 Jun 03 12:13:09.699959 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 469/918] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:10.479103 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:10.479664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:10.486095 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:10.486537 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:10.487289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:10.487743 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:10.613532 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:10.620882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1ae79237-9c3d-4bef-aaa5-4b388bef3ffe tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.145722 Jun 03 12:13:10.621438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 450/919] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:10 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:13:11.639643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:11.640724 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:11.646975 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:11.647418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:11.648238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:11.648673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:11.777008 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:11.784935 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-81da180e-3cd2-4893-87b1-a8f60992706f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.150303 Jun 03 12:13:11.785501 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 470/920] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:11 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:12.801779 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:12.802402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:12.808842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:12.809288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:12.810045 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:12.810482 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:13.049596 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:13.057186 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-59158e85-bd8f-4099-9255-0a881d173610 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.259379 Jun 03 12:13:13.067351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 451/921] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:12 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:14.074896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:14.075530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:14.082103 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:14.082544 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:14.083304 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:14.083767 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:14.208413 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:14.215815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f28206e0-863d-4184-81b9-3f81e2f42dfd tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.144947 Jun 03 12:13:14.216425 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 471/922] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:14 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:15.231884 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:15.232524 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:15.240238 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:15.240692 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:15.241450 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:15.241886 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:15.375204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:15.382951 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b2d778b5-ed11-475d-86f1-9fd5e7d2f3d0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.154830 Jun 03 12:13:15.383539 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 452/923] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:15 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:15.488648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-a7c3e394-1860-4e84-ae0c-7dbfebaaffc5 req-17ff7a8b-90ce-4743-bc6c-252cc5647cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dac7a24-2d7f-4466-87e8-3a67fcfe65af", "name": "network-vif-plugged", "status": "completed", "tag": "10c9bd2f-8ecb-4131-81d2-de3518b0b238"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:15.498985 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-a7c3e394-1860-4e84-ae0c-7dbfebaaffc5 req-17ff7a8b-90ce-4743-bc6c-252cc5647cbb service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:15.499429 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-a7c3e394-1860-4e84-ae0c-7dbfebaaffc5 req-17ff7a8b-90ce-4743-bc6c-252cc5647cbb service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:15.513517 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-a7c3e394-1860-4e84-ae0c-7dbfebaaffc5 req-17ff7a8b-90ce-4743-bc6c-252cc5647cbb service nova] Creating event network-vif-plugged:10c9bd2f-8ecb-4131-81d2-de3518b0b238 for instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af on hv-cinder-84457 Jun 03 12:13:15.518366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-a7c3e394-1860-4e84-ae0c-7dbfebaaffc5 req-17ff7a8b-90ce-4743-bc6c-252cc5647cbb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033565 Jun 03 12:13:15.519811 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 472/924] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:13:16.399907 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:16.400882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:16.412967 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:16.413408 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:16.414182 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:16.414617 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:16.551621 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:16.559100 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-36f0834d-59cd-4e3d-8e8f-83271bca9ca9 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1319 microversion: 2.1 time: 0.163054 Jun 03 12:13:16.559691 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 453/925] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:16 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:17.032491 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:17.033230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:17.221285 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:17.221906 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:17.228036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:17.228486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:17.229240 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:17.229677 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:17.254122 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-21ac742e-74e9-482c-9a86-937c4986455a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/ips" status: 200 len: 151 microversion: 2.1 time: 0.226827 Jun 03 12:13:17.254676 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 473/926] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:13:17 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/ips => generated 151 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:17.575825 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:17.576436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:17.578289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:17.584106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:17.584543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:17.585288 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:17.585717 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:17.714066 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:17.721447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-70d48335-e640-4d68-915d-b8986205431d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1508 microversion: 2.1 time: 0.149438 Jun 03 12:13:17.722661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 454/927] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:17 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:18.576216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "926f0f22-e0e6-4b99-a560-0558ce2e2ddc"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:18.577333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:18.584658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:18.585102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:18.586041 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:18.586418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:18.853794 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2f6799d3-404c-4f42-a44f-7f6e05aef55a tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281443 Jun 03 12:13:18.855089 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 474/928] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:13:18 2022] POST /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:26.359300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "926f0f22-e0e6-4b99-a560-0558ce2e2ddc"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:26.360414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:26.367151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:26.367616 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:26.368369 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:26.368796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:26.461750 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Invalid volume: volume 926f0f22-e0e6-4b99-a560-0558ce2e2ddc is already attached to instances: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments HTTP/1.1 Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 74 Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:13:26.463464 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {"volumeAttachment": {"volumeId": "926f0f22-e0e6-4b99-a560-0558ce2e2ddc"}} Jun 03 12:13:26.466026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Invalid volume: volume 926f0f22-e0e6-4b99-a560-0558ce2e2ddc is already attached to instances: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'server_id': '53a78daf-c3d9-4d83-9c4d-3a4e184d45f3', 'body': {'volumeAttachment': {'volumeId': '926f0f22-e0e6-4b99-a560-0558ce2e2ddc'}}} Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 926f0f22-e0e6-4b99-a560-0558ce2e2ddc is already attached to instances: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:26.466857 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 926f0f22-e0e6-4b99-a560-0558ce2e2ddc is already attached to instances: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:13:26.468124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 926f0f22-e0e6-4b99-a560-0558ce2e2ddc is already attached to instances: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 400 to user: Invalid volume: volume 926f0f22-e0e6-4b99-a560-0558ce2e2ddc is already attached to instances: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ed250e95-02a0-4068-90b0-3b647288d6c7 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109648 Jun 03 12:13:26.469736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 455/929] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:13:26 2022] POST /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 12:13:26.530233 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:26.530756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:26.538260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:26.538715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:26.539475 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:26.539938 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:26.617993 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lazy-loading 'services' on Instance uuid 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:13:26.694501 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-71e30136-6101-417a-8c28-6ae80b929e3f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments/926f0f22-e0e6-4b99-a560-0558ce2e2ddc" status: 202 len: 0 microversion: 2.1 time: 0.167424 Jun 03 12:13:26.695271 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 475/930] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:13:26 2022] DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments/926f0f22-e0e6-4b99-a560-0558ce2e2ddc => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:13:26.705077 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:26.706403 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:26.714059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:26.714622 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:26.715614 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:26.716048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:26.745167 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b08120e1-b42c-4c82-b4d2-0adfc5dd07ed tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Jun 03 12:13:26.745711 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 456/931] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:13:26 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:27.759176 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:27.760286 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:27.766466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:27.766915 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:27.767708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:27.768144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:27.796636 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b410a67b-7b50-41c1-9c93-7a56c33e28de tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042844 Jun 03 12:13:27.797110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 476/932] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:13:27 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:13:27.867431 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:27.867969 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:27.874502 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:27.874950 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:27.875735 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:27.876174 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:27.902153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:13:27.973548 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e120862f-0e9a-4a50-9407-c250713f1313 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 204 len: 0 microversion: 2.1 time: 0.110211 Jun 03 12:13:27.974223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 457/933] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:13:27 2022] DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:13:27.983064 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:27.983708 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:27.989721 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:27.990163 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:27.991417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:27.991868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:28.137119 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:28.144496 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d01723ce-e1f7-4586-a68d-49e65e159555 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1683 microversion: 2.1 time: 0.165251 Jun 03 12:13:28.145050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 477/934] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:27 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:29.163397 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:29.164036 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:29.170414 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:29.170862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:29.171645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:29.172076 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:29.299463 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:29.307681 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fefdd0b2-f166-4850-b0d5-6e4846035f47 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1683 microversion: 2.1 time: 0.148589 Jun 03 12:13:29.308391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 458/935] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:29 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:30.325885 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:30.327410 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:30.333980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:30.335075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:30.335868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:30.336315 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:30.468642 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:30.477575 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b192e8ec-eb19-43e4-9ea3-58a3472694fd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1683 microversion: 2.1 time: 0.155508 Jun 03 12:13:30.478329 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 478/936] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:30 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:31.336886 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-c560c7ee-f8d1-4596-8c34-8e1c3f8a4e9b req-ad55bb22-019f-488c-80e5-a0d1a40e20f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a78daf-c3d9-4d83-9c4d-3a4e184d45f3", "name": "network-vif-deleted", "tag": "e250f690-2907-48e3-aed0-5f2131f50904"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:31.346482 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-c560c7ee-f8d1-4596-8c34-8e1c3f8a4e9b req-ad55bb22-019f-488c-80e5-a0d1a40e20f9 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:31.346949 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-c560c7ee-f8d1-4596-8c34-8e1c3f8a4e9b req-ad55bb22-019f-488c-80e5-a0d1a40e20f9 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:31.359207 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-c560c7ee-f8d1-4596-8c34-8e1c3f8a4e9b req-ad55bb22-019f-488c-80e5-a0d1a40e20f9 service nova] Creating event network-vif-deleted:e250f690-2907-48e3-aed0-5f2131f50904 for instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 on hv-cinder-84457 Jun 03 12:13:31.366112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-c560c7ee-f8d1-4596-8c34-8e1c3f8a4e9b req-ad55bb22-019f-488c-80e5-a0d1a40e20f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 Jun 03 12:13:31.366892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 459/937] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:31.503043 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:31.504771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:31.513839 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:31.514461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:31.515680 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:31.516261 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:31.556149 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:31.556583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:31.557029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lazy-loading 'fault' on Instance uuid 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:13:31.607950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:31.616166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a52a57bc-c0c8-4691-936f-e8533e8171f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 200 len: 1331 microversion: 2.1 time: 0.117177 Jun 03 12:13:31.616734 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 479/938] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:31 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:32.635428 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:32.636070 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:32.642327 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:32.642776 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:32.643552 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:32.643993 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:32.660045 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 HTTP/1.1 Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:13:32.661631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:13:32.663261 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '53a78daf-c3d9-4d83-9c4d-3a4e184d45f3'} Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:13:32.664402 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:13:32.665962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:13:32.667424 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:13:32.667424 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5873ef18-3cb6-4856-b5a4-3a75d756df87 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 404 len: 111 microversion: 2.1 time: 0.032875 Jun 03 12:13:32.667424 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 460/939] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:32 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:13:32.671777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d9ad9135-945e-4062-bd29-dd0cfe1239a0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '.version_select at 0x7f19c5cd55e0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:32.689046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d9ad9135-945e-4062-bd29-dd0cfe1239a0 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913337731" status: 202 len: 0 microversion: 2.1 time: 0.021009 Jun 03 12:13:32.689585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 480/940] 10.222.0.15 () {58 vars in 1220 bytes} [Fri Jun 3 12:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913337731 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:13:33.286754 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-36d287fc-b516-450a-a836-7e6dada1f01c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: .version_select at 0x7f19c5b56820>, body: {"keypair": {"name": "tempest-keypair-649605335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCin3r5VCOzm2UOZdgah1XXRZG4pHWdq0weVlLO+V6mL/CP3wqnPcuUd+bdiMyjvGclI3nlGTgBe5h4FJUWypplkrGyELiDcvo2R8zQTIFAXfvbCV92oYjqMmykLkKyAg=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:33.300348 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-36d287fc-b516-450a-a836-7e6dada1f01c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:13:33.304624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-36d287fc-b516-450a-a836-7e6dada1f01c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:13:33.326256 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-36d287fc-b516-450a-a836-7e6dada1f01c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043342 Jun 03 12:13:33.326834 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 461/941] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:13:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:34.582512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-70079616", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d93d3bc-8776-4cd1-bb83-66977617e90d"}], "security_groups": [{"name": "tempest-securitygroup--278865601"}], "key_name": "tempest-keypair-649605335", "user_data": "}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:34.681592 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] validate_networks() for [('5d93d3bc-8776-4cd1-bb83-66977617e90d', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:13:35.039234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:13:35.039690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:13:35.040158 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:13:35.040587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:13:35.040990 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:13:35.049800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:35.050241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:35.051016 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:35.051443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:35.068353 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:13:35.072141 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Getting quotas for user 0c93102a757d4a2cbf7f515c4b67db2c and project 6f92333085e341938aaf258c0921cd5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:13:35.082570 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:13:35.084831 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:13:35.133933 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-008aaafc-1e5e-4ffb-a2c5-984a6c56cc5f tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556085 Jun 03 12:13:35.134610 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 481/942] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:13:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:13:35.145216 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-db08dd62-41eb-427e-9d6f-e227145234d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:35.145922 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-db08dd62-41eb-427e-9d6f-e227145234d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:35.203365 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-db08dd62-41eb-427e-9d6f-e227145234d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:35.212044 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-db08dd62-41eb-427e-9d6f-e227145234d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1239 microversion: 2.1 time: 0.070868 Jun 03 12:13:35.212589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 462/943] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:35 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:36.230091 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:36.230665 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:36.240146 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:36.240594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:36.241356 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:36.241999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:36.304346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:36.311775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3ddac402-56ae-4cc9-b293-8b3876da8a63 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1309 microversion: 2.1 time: 0.086413 Jun 03 12:13:36.312334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 482/944] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:36 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:37.329109 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:37.329745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:37.332195 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:37.337764 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:37.338223 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:37.339000 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:37.339441 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:37.344680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:37.564737 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:37.573286 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5d540e9f-94b4-4dc0-bd90-09d1bbd98240 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.247877 Jun 03 12:13:37.573869 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 463/945] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:37 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:37.785577 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-989a68d2-07c2-406d-8b9e-e27ff5297a22 req-cf92b53a-d625-4b53-ad64-6128825a4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fd0ff2-7313-466f-837c-0f69348179d2", "tag": "2c34ff56-2711-40f0-943d-862eb54fcfd9"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:37.790927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:37.796861 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-989a68d2-07c2-406d-8b9e-e27ff5297a22 req-cf92b53a-d625-4b53-ad64-6128825a4d67 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:37.797296 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-989a68d2-07c2-406d-8b9e-e27ff5297a22 req-cf92b53a-d625-4b53-ad64-6128825a4d67 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:37.802112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:37.811922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-989a68d2-07c2-406d-8b9e-e27ff5297a22 req-cf92b53a-d625-4b53-ad64-6128825a4d67 service nova] Creating event network-changed:2c34ff56-2711-40f0-943d-862eb54fcfd9 for instance 25fd0ff2-7313-466f-837c-0f69348179d2 on hv-cinder-84457 Jun 03 12:13:37.816907 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-989a68d2-07c2-406d-8b9e-e27ff5297a22 req-cf92b53a-d625-4b53-ad64-6128825a4d67 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035236 Jun 03 12:13:37.817494 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 483/946] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:13:38.590084 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:38.590701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:38.597132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:38.597581 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:38.598371 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:38.598805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:38.732289 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:38.739842 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-32346b5d-e26f-4254-9fec-189e1a6fc45d tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.153530 Jun 03 12:13:38.740467 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 464/947] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:38 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:39.759139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:39.759870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:39.766880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:39.767327 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:39.768127 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:39.768537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:39.895075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:39.902887 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4c346429-8423-433d-ab26-554bdad001e3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.150081 Jun 03 12:13:39.903442 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 484/948] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:39 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:40.919635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:40.920280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:40.926709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:40.927163 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:40.928468 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:40.928904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:41.055037 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:41.062429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bec0581b-1f9d-483e-87f8-68fe73845986 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.146776 Jun 03 12:13:41.062988 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 465/949] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:40 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:41.218067 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bf49daa-3d29-488d-babb-938612d665c6", "device": "/dev/sdb"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:41.219715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:41.226740 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:41.227184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:41.227975 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:41.228406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:41.858543 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-98be9bdd-96dc-478b-9b83-ecc374991edc tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "POST /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644287 Jun 03 12:13:41.859177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 485/950] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:13:41 2022] POST /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af/os-volume_attachments => generated 194 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:42.078224 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:42.079291 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:42.085396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:42.085845 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:42.086605 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:42.087041 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:42.274322 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:42.282042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7c474f6d-167a-40df-aa3c-a8eadcc2b980 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.207688 Jun 03 12:13:42.291943 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 466/951] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:42 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:43.300410 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:43.301021 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:43.307252 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:43.307722 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:43.308699 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:43.309136 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:43.436214 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:43.443950 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-49931ef7-cbf0-46c1-b23a-4239c9006a78 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.147858 Jun 03 12:13:43.444505 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 486/952] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:43 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:43.683549 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-fe3e0395-88b3-49c2-a2d0-a2f099ba280d req-b435491b-66da-4cd0-b7c5-9244f2aa3b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fd0ff2-7313-466f-837c-0f69348179d2", "name": "network-vif-plugged", "status": "completed", "tag": "2c34ff56-2711-40f0-943d-862eb54fcfd9"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:43.691983 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-fe3e0395-88b3-49c2-a2d0-a2f099ba280d req-b435491b-66da-4cd0-b7c5-9244f2aa3b46 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:43.693026 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-fe3e0395-88b3-49c2-a2d0-a2f099ba280d req-b435491b-66da-4cd0-b7c5-9244f2aa3b46 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:43.704002 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-fe3e0395-88b3-49c2-a2d0-a2f099ba280d req-b435491b-66da-4cd0-b7c5-9244f2aa3b46 service nova] Creating event network-vif-plugged:2c34ff56-2711-40f0-943d-862eb54fcfd9 for instance 25fd0ff2-7313-466f-837c-0f69348179d2 on hv-cinder-84457 Jun 03 12:13:43.708798 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-fe3e0395-88b3-49c2-a2d0-a2f099ba280d req-b435491b-66da-4cd0-b7c5-9244f2aa3b46 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029022 Jun 03 12:13:43.709594 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 467/953] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:13:44.461004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:44.461606 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:44.468306 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:44.468745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:44.469527 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:44.469978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:44.604161 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:44.612233 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f55a12a4-fdd6-49d1-8867-fc52b63c80f6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1364 microversion: 2.1 time: 0.155542 Jun 03 12:13:44.612934 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 487/954] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:44 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:45.627817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:45.632692 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:45.633522 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:45.641057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:45.641587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:45.642462 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:45.642979 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:45.785862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:13:45.794366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c09f863a-6ba8-4975-95b6-2206ea67d98b tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1554 microversion: 2.1 time: 0.168416 Jun 03 12:13:45.794933 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 468/955] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:13:45 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:13:45.810899 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:13:45.811434 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:13:45.813736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:45.814385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:45.820047 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:45.820486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:45.821238 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:45.821662 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:45.904013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d6aff68b-98e5-4a05-9e14-cfbd370e7a8c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096850 Jun 03 12:13:45.904599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 488/956] 10.222.0.15 () {58 vars in 1274 bytes} [Fri Jun 3 12:13:45 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:13:47.139153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-5502c512-c721-48ea-8af3-ee75a3ee8d0e req-88403181-1c55-45ba-97af-dedd23b94c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fd0ff2-7313-466f-837c-0f69348179d2", "tag": "2c34ff56-2711-40f0-943d-862eb54fcfd9"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:13:47.147861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5502c512-c721-48ea-8af3-ee75a3ee8d0e req-88403181-1c55-45ba-97af-dedd23b94c49 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:13:47.148466 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5502c512-c721-48ea-8af3-ee75a3ee8d0e req-88403181-1c55-45ba-97af-dedd23b94c49 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:13:47.164260 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-5502c512-c721-48ea-8af3-ee75a3ee8d0e req-88403181-1c55-45ba-97af-dedd23b94c49 service nova] Creating event network-changed:2c34ff56-2711-40f0-943d-862eb54fcfd9 for instance 25fd0ff2-7313-466f-837c-0f69348179d2 on hv-cinder-84457 Jun 03 12:13:47.169889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-5502c512-c721-48ea-8af3-ee75a3ee8d0e req-88403181-1c55-45ba-97af-dedd23b94c49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109965 Jun 03 12:13:47.170659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 469/957] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:14:10.684343 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=11 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:10.685199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:10.689212 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:10.689714 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:10.697214 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:10.697649 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:10.698391 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:10.698815 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:10.830831 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lazy-loading 'services' on Instance uuid 0dac7a24-2d7f-4466-87e8-3a67fcfe65af {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:14:10.900697 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-fe05ea41-9e72-4592-8b61-1f827ce71c03 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af/os-volume_attachments/7bf49daa-3d29-488d-babb-938612d665c6" status: 202 len: 0 microversion: 2.1 time: 0.217070 Jun 03 12:14:10.901391 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 489/958] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:14:10 2022] DELETE /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af/os-volume_attachments/7bf49daa-3d29-488d-babb-938612d665c6 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:14:13.077504 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:13.078117 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:13.080434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=13 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:13.081069 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=33 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:13.086778 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:13.087226 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:13.088023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:13.088457 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:13.112438 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:14:13.187305 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dfe99043-e319-486c-82e8-2c444857c19d tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 204 len: 0 microversion: 2.1 time: 0.113340 Jun 03 12:14:13.188265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 470/959] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:14:13 2022] DELETE /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:14:13.200053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:13.200846 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:13.207853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:13.208302 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:13.209065 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:13.209501 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:13.335455 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:13.342927 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-76c17b09-588e-4a5d-82e6-283d2c07f4c4 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1514 microversion: 2.1 time: 0.148160 Jun 03 12:14:13.343490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 490/960] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:13 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:14:14.360796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:14.361493 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:14.368469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:14.368913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:14.369661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:14.370092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:14.563449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:14.571579 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-40e8a38d-39d5-47a3-afdb-e1638a7442ca tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1514 microversion: 2.1 time: 0.214965 Jun 03 12:14:14.572136 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 471/961] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:14 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:15.589045 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:15.589643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:15.596118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:15.596571 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:15.597320 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:15.597753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:15.730792 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:15.738194 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-441b15c3-ab1c-4cb5-a50d-ac3addddbece tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1514 microversion: 2.1 time: 0.153718 Jun 03 12:14:15.738753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 491/962] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:15 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:16.434061 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-bf291408-5a5f-4074-a767-50e901e7cc6a req-c0413e8b-1204-4180-932c-4838e67b4126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dac7a24-2d7f-4466-87e8-3a67fcfe65af", "name": "network-vif-deleted", "tag": "10c9bd2f-8ecb-4131-81d2-de3518b0b238"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:14:16.442516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bf291408-5a5f-4074-a767-50e901e7cc6a req-c0413e8b-1204-4180-932c-4838e67b4126 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:16.443042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bf291408-5a5f-4074-a767-50e901e7cc6a req-c0413e8b-1204-4180-932c-4838e67b4126 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:16.454429 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-bf291408-5a5f-4074-a767-50e901e7cc6a req-c0413e8b-1204-4180-932c-4838e67b4126 service nova] Creating event network-vif-deleted:10c9bd2f-8ecb-4131-81d2-de3518b0b238 for instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af on hv-cinder-84457 Jun 03 12:14:16.459329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-bf291408-5a5f-4074-a767-50e901e7cc6a req-c0413e8b-1204-4180-932c-4838e67b4126 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085367 Jun 03 12:14:16.460191 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 472/963] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:14:16.756030 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:16.756575 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:16.763760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:16.764208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:16.764972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:16.765404 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:16.796840 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:16.797283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:16.797729 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lazy-loading 'fault' on Instance uuid 0dac7a24-2d7f-4466-87e8-3a67fcfe65af {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:14:16.840113 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:16.847733 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5be5fa38-3e7e-485a-bf3a-f3a71fc44086 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 200 len: 1309 microversion: 2.1 time: 0.095786 Jun 03 12:14:16.848324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 492/964] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:16 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:17.866189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:17.867459 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 0dac7a24-2d7f-4466-87e8-3a67fcfe65af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:17.874561 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:17.875097 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:17.876094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:17.876665 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:17.892979 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] HTTP exception thrown: Instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af could not be found. Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Request method failure captured: Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af HTTP/1.1 Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfrRGxTCeduiGi42KF--twH2rLOptq57n_6EG4Ry0DlpotdD40nyMcTT9bHH0JAMhfuuoXqtaagS1dSArI7X40D9Kf4cylrl9HbW_9puUHwWeNynU7TvCVBnwp5BSqYwdZBCJWwFC1sUzMmhsj6W4fQAVF8JjnQuEy9mcqqEv1HS40g Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 4aec940c9f514bd9923ad6d815618e44 Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1436544623 Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:14:17.894611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4aec940c9f514bd9923ad6d815618e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4aec940c9f514bd9923ad6d815618e44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4aec940c9f514bd9923ad6d815618e44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4aec940c9f514bd9923ad6d815618e44"}]}] Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotTestJSON-1436544623 Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 4aec940c9f514bd9923ad6d815618e44 Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1436544623 Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotTestJSON-1436544623-project Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 4c59e1a01e9d4e3da0ea941b97cdab2c Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotTestJSON-1436544623-project Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af could not be found. Jun 03 12:14:17.896280 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '0dac7a24-2d7f-4466-87e8-3a67fcfe65af'} Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af could not be found. Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:14:17.897141 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af could not be found. Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af could not be found. Jun 03 12:14:17.898736 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:14:17.899966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Returning 404 to user: Instance 0dac7a24-2d7f-4466-87e8-3a67fcfe65af could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:14:17.899966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-67346fe1-8d09-425d-80f3-026f4884136e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af" status: 404 len: 111 microversion: 2.1 time: 0.034851 Jun 03 12:14:17.899966 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 473/965] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:17 2022] GET /compute/v2.1/servers/0dac7a24-2d7f-4466-87e8-3a67fcfe65af => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:14:30.779870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2131431834", "imageRef": "3c06d38b-0319-415d-abea-380464fd1808", "flavorRef": "452", "networks": [{"uuid": "9845895d-3584-4a6e-a1fc-e601ae378637"}]}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:14:30.787144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=10 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:30.787807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:30.832319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.network.neutron [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] validate_networks() for [('9845895d-3584-4a6e-a1fc-e601ae378637', None, None, None, None, None)] {{(pid=117617) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:14:31.168514 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Flavor limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:14:31.168939 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Image limits 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:14:31.169411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Flavor pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:14:31.169818 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Image pref 0:0:0 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:14:31.170230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.virt.hardware [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:14:31.180206 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:31.180659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:31.181460 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:31.181894 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:31.198769 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Getting quotas for project 4aec940c9f514bd9923ad6d815618e44. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:14:31.202701 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Getting quotas for user 4c59e1a01e9d4e3da0ea941b97cdab2c and project 4aec940c9f514bd9923ad6d815618e44. Resources: {'instances', 'cores', 'ram'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:14:31.214744 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Going to run 1 instances... {{(pid=117617) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:14:31.217139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c06d38b-0319-415d-abea-380464fd1808',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:14:31.265412 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a4ac1f9d-1bcc-46b8-991b-3656a23628df tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489393 Jun 03 12:14:31.266199 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 493/966] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:14:31.277046 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ac652378-5670-47aa-ace7-507bc4e85924 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:31.277686 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ac652378-5670-47aa-ace7-507bc4e85924 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:31.280241 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:31.280921 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:31.340302 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ac652378-5670-47aa-ace7-507bc4e85924 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:31.347460 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ac652378-5670-47aa-ace7-507bc4e85924 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1219 microversion: 2.1 time: 0.074862 Jun 03 12:14:31.348109 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 474/967] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:31 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:32.365082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:32.365773 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:32.373111 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:32.373561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:32.374331 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:32.374766 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:32.442336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:32.450111 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9283af6e-9239-46fd-aeaa-1b2b8c911fd2 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1279 microversion: 2.1 time: 0.089913 Jun 03 12:14:32.459612 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 494/968] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:32 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:33.467124 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:33.467767 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:33.474231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:33.474684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:33.475442 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:33.475907 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:33.712890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:33.720545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e199d7c3-495c-4209-9541-a68f93721748 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.257275 Jun 03 12:14:33.721116 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 475/969] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:33 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:34.049372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-8bf32ef3-2b27-43ef-92f6-30d1721f7d6c req-4ef01254-951e-4aa6-b3b4-bf62d9178242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397d7c32-6381-49dd-b3af-aa0508b290c3", "tag": "607862c0-4306-48df-9008-ed5283fc44db"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:14:34.058591 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-8bf32ef3-2b27-43ef-92f6-30d1721f7d6c req-4ef01254-951e-4aa6-b3b4-bf62d9178242 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:34.059109 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-8bf32ef3-2b27-43ef-92f6-30d1721f7d6c req-4ef01254-951e-4aa6-b3b4-bf62d9178242 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:34.070267 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-8bf32ef3-2b27-43ef-92f6-30d1721f7d6c req-4ef01254-951e-4aa6-b3b4-bf62d9178242 service nova] Creating event network-changed:607862c0-4306-48df-9008-ed5283fc44db for instance 397d7c32-6381-49dd-b3af-aa0508b290c3 on hv-cinder-84457 Jun 03 12:14:34.075099 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-8bf32ef3-2b27-43ef-92f6-30d1721f7d6c req-4ef01254-951e-4aa6-b3b4-bf62d9178242 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029469 Jun 03 12:14:34.075712 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 495/970] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:14:34.738048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:34.738694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:34.745156 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:34.745604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:34.746358 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:34.746794 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:34.876687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:34.884587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-84e15f11-15af-4ce6-8e68-345b9a8bcb7b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.150376 Jun 03 12:14:34.885142 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 476/971] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:34 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:35.902866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:35.903589 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:35.909922 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:35.910366 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:35.911118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:35.911615 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:36.037674 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:36.045005 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-82aa742e-c46d-4910-bfde-a5d60eebef96 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.147646 Jun 03 12:14:36.045559 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 496/972] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:35 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:37.063879 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:37.064519 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:37.071544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:37.071992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:37.072753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:37.073215 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:37.279039 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:37.286528 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-611278fc-8b4d-466c-8219-d0fd1f8e9552 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.226624 Jun 03 12:14:37.287082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 477/973] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:37 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:38.303414 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:38.303987 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:38.310486 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:38.310931 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:38.311722 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:38.312155 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:38.440980 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:38.449290 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-31e94456-c453-4eec-a3ea-ad7daa12b70c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.149890 Jun 03 12:14:38.449849 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 497/974] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:38 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:39.466419 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:39.467152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:39.473861 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:39.474307 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:39.475063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:39.475571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:39.607412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:39.614695 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a9aee1c7-9b54-4f26-9d93-1709b71a62b0 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.152106 Jun 03 12:14:39.615244 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 478/975] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:39 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:39.874598 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-939cc52d-85ad-46a6-a119-e273e69bcb0d req-2f6b0e8a-99dc-4364-af27-24bdb9bc8803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d7c32-6381-49dd-b3af-aa0508b290c3", "name": "network-vif-plugged", "status": "completed", "tag": "607862c0-4306-48df-9008-ed5283fc44db"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:14:39.883139 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-939cc52d-85ad-46a6-a119-e273e69bcb0d req-2f6b0e8a-99dc-4364-af27-24bdb9bc8803 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:39.884082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-939cc52d-85ad-46a6-a119-e273e69bcb0d req-2f6b0e8a-99dc-4364-af27-24bdb9bc8803 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:39.894475 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-939cc52d-85ad-46a6-a119-e273e69bcb0d req-2f6b0e8a-99dc-4364-af27-24bdb9bc8803 service nova] Creating event network-vif-plugged:607862c0-4306-48df-9008-ed5283fc44db for instance 397d7c32-6381-49dd-b3af-aa0508b290c3 on hv-cinder-84457 Jun 03 12:14:39.900432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-939cc52d-85ad-46a6-a119-e273e69bcb0d req-2f6b0e8a-99dc-4364-af27-24bdb9bc8803 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087322 Jun 03 12:14:39.901274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 498/976] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:14:40.631612 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:40.632225 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:40.638821 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:40.639267 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:40.640048 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:40.640484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:40.769946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:40.777803 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6a497fdf-8e00-4e0d-87f1-2f50a298be75 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1319 microversion: 2.1 time: 0.150120 Jun 03 12:14:40.778363 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 479/977] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:40 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:41.796983 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:41.797882 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:41.802888 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:14:41.803826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:41.812897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:41.813462 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:41.814396 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:41.814897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:41.948889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:14:41.956319 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0bfba1c6-6c93-473f-a6fe-214ef01fe267 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1508 microversion: 2.1 time: 0.161347 Jun 03 12:14:41.956887 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 499/978] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:14:41 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:14:41.972496 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b8c4fce-e6d3-4c4e-bc71-1629dd9059b9", "device": "/dev/sdb"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:14:41.974108 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:14:41.976051 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:41.981742 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:41.982189 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:41.982956 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:14:41.983394 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:14:42.409225 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-85d60184-5965-4f6b-9b49-ade20e45e144 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "POST /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440480 Jun 03 12:14:42.409841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 480/979] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:14:41 2022] POST /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:15:04.772626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:04.773162 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:04.775000 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:04.776015 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=30 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:04.782114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:04.782566 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:04.783372 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:04.783808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:04.862294 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lazy-loading 'services' on Instance uuid 397d7c32-6381-49dd-b3af-aa0508b290c3 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:15:04.931958 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-26d4c9c4-3a63-4cee-8e66-61bdae94c29f tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "DELETE /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3/os-volume_attachments/1b8c4fce-e6d3-4c4e-bc71-1629dd9059b9" status: 202 len: 0 microversion: 2.1 time: 0.163126 Jun 03 12:15:04.932532 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 500/980] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:15:04 2022] DELETE /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3/os-volume_attachments/1b8c4fce-e6d3-4c4e-bc71-1629dd9059b9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:15:06.044505 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:06.045094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:06.047619 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=16 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:06.048427 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:06.054190 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:06.054632 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:06.055412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:06.055863 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:06.081422 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:15:06.154544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e0e6d1d9-75a5-4cb6-8f17-62106c5a4f3c tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "DELETE /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 204 len: 0 microversion: 2.1 time: 0.114474 Jun 03 12:15:06.155206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 481/981] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:15:06 2022] DELETE /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:15:06.164392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:06.165094 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:06.172088 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:06.172531 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:06.173286 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:06.173715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:06.307370 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:06.315031 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8d643edb-f106-41a6-a94b-8ddd5e9b0410 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1514 microversion: 2.1 time: 0.155471 Jun 03 12:15:06.315615 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 501/982] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:06 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:07.333091 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:07.333810 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:07.340248 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:07.340701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:07.341465 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:07.341913 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:07.470543 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:07.478906 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b558a08f-b06e-49dd-9af4-8e5f322a783e tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1514 microversion: 2.1 time: 0.149940 Jun 03 12:15:07.479579 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 482/983] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:07 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:08.497756 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:08.498381 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:08.505549 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:08.505991 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:08.506737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:08.507164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:08.572449 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c59e1a01e9d4e3da0ea941b97cdab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aec940c9f514bd9923ad6d815618e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:08.578853 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-05faded0-ef8f-498e-a4c7-077a10934d5b tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 200 len: 1472 microversion: 2.1 time: 0.085623 Jun 03 12:15:08.588255 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 502/984] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:08 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:08.625758 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-5e134524-b45a-4d70-91dd-4844b829e39c req-f35fb80c-4650-426b-a1d8-41b6b38f4bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397d7c32-6381-49dd-b3af-aa0508b290c3", "name": "network-vif-deleted", "tag": "607862c0-4306-48df-9008-ed5283fc44db"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:15:08.634436 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5e134524-b45a-4d70-91dd-4844b829e39c req-f35fb80c-4650-426b-a1d8-41b6b38f4bd2 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:08.634869 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5e134524-b45a-4d70-91dd-4844b829e39c req-f35fb80c-4650-426b-a1d8-41b6b38f4bd2 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:08.646816 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-5e134524-b45a-4d70-91dd-4844b829e39c req-f35fb80c-4650-426b-a1d8-41b6b38f4bd2 service nova] Creating event network-vif-deleted:607862c0-4306-48df-9008-ed5283fc44db for instance 397d7c32-6381-49dd-b3af-aa0508b290c3 on hv-cinder-84457 Jun 03 12:15:08.652152 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-5e134524-b45a-4d70-91dd-4844b829e39c req-f35fb80c-4650-426b-a1d8-41b6b38f4bd2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jun 03 12:15:08.652817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 483/985] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:15:09.595948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:09.596578 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] [instance: 397d7c32-6381-49dd-b3af-aa0508b290c3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:09.603013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:09.603457 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:09.604256 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:09.604689 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:09.618604 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] HTTP exception thrown: Instance 397d7c32-6381-49dd-b3af-aa0508b290c3 could not be found. Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Request method failure captured: Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 HTTP/1.1 Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfrRGxTCeduiGi42KF--twH2rLOptq57n_6EG4Ry0DlpotdD40nyMcTT9bHH0JAMhfuuoXqtaagS1dSArI7X40D9Kf4cylrl9HbW_9puUHwWeNynU7TvCVBnwp5BSqYwdZBCJWwFC1sUzMmhsj6W4fQAVF8JjnQuEy9mcqqEv1HS40g Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 4aec940c9f514bd9923ad6d815618e44 Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1436544623 Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:15:09.620379 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4aec940c9f514bd9923ad6d815618e44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4aec940c9f514bd9923ad6d815618e44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4aec940c9f514bd9923ad6d815618e44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4aec940c9f514bd9923ad6d815618e44"}]}] Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-VolumesSnapshotTestJSON-1436544623 Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 4aec940c9f514bd9923ad6d815618e44 Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1436544623 Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-VolumesSnapshotTestJSON-1436544623-project Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 4c59e1a01e9d4e3da0ea941b97cdab2c Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-VolumesSnapshotTestJSON-1436544623-project Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 397d7c32-6381-49dd-b3af-aa0508b290c3 could not be found. Jun 03 12:15:09.622004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '397d7c32-6381-49dd-b3af-aa0508b290c3'} Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397d7c32-6381-49dd-b3af-aa0508b290c3 could not be found. Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:15:09.622822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397d7c32-6381-49dd-b3af-aa0508b290c3 could not be found. Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397d7c32-6381-49dd-b3af-aa0508b290c3 could not be found. Jun 03 12:15:09.624947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:09.626168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] Returning 404 to user: Instance 397d7c32-6381-49dd-b3af-aa0508b290c3 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:15:09.626168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-63107738-2add-4f4b-9500-4f5d65cb0991 tempest-VolumesSnapshotTestJSON-1436544623 tempest-VolumesSnapshotTestJSON-1436544623-project] 10.222.0.15 "GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3" status: 404 len: 111 microversion: 2.1 time: 0.029855 Jun 03 12:15:09.626168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 503/986] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:09 2022] GET /compute/v2.1/servers/397d7c32-6381-49dd-b3af-aa0508b290c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:15:11.560353 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:15:11.560953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:15:23.105533 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:23.106360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:23.110789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-93bce533-1230-4a87-aabc-9453fd8f9292 req-ade8bca9-8619-433d-b15a-433452833125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6bed96-0a2e-4712-bbde-82b4e42da6e9", "tag": "2402dcad-a071-4205-a599-0096541544f3"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:15:23.111262 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:23.111382 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:23.118335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=8 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:23.118872 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:23.119054 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:23.119670 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:23.120515 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:23.121017 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:23.121250 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-93bce533-1230-4a87-aabc-9453fd8f9292 req-ade8bca9-8619-433d-b15a-433452833125 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:23.121657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-93bce533-1230-4a87-aabc-9453fd8f9292 req-ade8bca9-8619-433d-b15a-433452833125 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:23.137601 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-93bce533-1230-4a87-aabc-9453fd8f9292 req-ade8bca9-8619-433d-b15a-433452833125 service nova] Creating event network-changed:2402dcad-a071-4205-a599-0096541544f3 for instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 on hv-cinder-84457 Jun 03 12:15:23.143778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-93bce533-1230-4a87-aabc-9453fd8f9292 req-ade8bca9-8619-433d-b15a-433452833125 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037223 Jun 03 12:15:23.144695 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 504/987] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:15:23.153964 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:15:23.233118 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-52d0343d-db6f-43a8-b2be-40738959f4a3 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 204 len: 0 microversion: 2.1 time: 0.128935 Jun 03 12:15:23.233709 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 484/988] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:15:23 2022] DELETE /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:15:23.242659 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:23.243362 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:23.250337 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:23.250785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:23.251577 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:23.252012 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:23.387737 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:23.395850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8383b18f-495a-4204-b1d2-cba0d3169f03 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1576 microversion: 2.1 time: 0.157621 Jun 03 12:15:23.396412 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 505/989] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:23 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:24.414372 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:24.415008 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:24.422047 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:24.422486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:24.423235 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:24.423694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:24.589523 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:24.597703 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-153cc961-ce87-4e71-be83-0ed100253e97 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1576 microversion: 2.1 time: 0.187582 Jun 03 12:15:24.598259 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 485/990] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:24 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:25.615638 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:25.616196 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:25.622968 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:25.623418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:25.624493 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:25.624850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:25.773266 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:25.782533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-73393512-be09-4e7a-89f6-494f93175469 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1576 microversion: 2.1 time: 0.171645 Jun 03 12:15:25.783646 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 506/991] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:25 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:26.799174 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:26.800138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:26.806661 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:26.807374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:26.808192 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:26.808633 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:27.048737 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:27.056201 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9876809f-9fc5-4b4f-bc46-02207f1940ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1457 microversion: 2.1 time: 0.260836 Jun 03 12:15:27.056753 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 486/992] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:26 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1457 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:27.324376 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-bc4173c1-c382-4417-8b95-f2fb8d20604d req-3ff40305-309e-455c-b261-329385a5b871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6bed96-0a2e-4712-bbde-82b4e42da6e9", "name": "network-vif-deleted", "tag": "2402dcad-a071-4205-a599-0096541544f3"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:15:27.334076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-bc4173c1-c382-4417-8b95-f2fb8d20604d req-3ff40305-309e-455c-b261-329385a5b871 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:27.334543 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-bc4173c1-c382-4417-8b95-f2fb8d20604d req-3ff40305-309e-455c-b261-329385a5b871 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:27.346269 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-bc4173c1-c382-4417-8b95-f2fb8d20604d req-3ff40305-309e-455c-b261-329385a5b871 service nova] Creating event network-vif-deleted:2402dcad-a071-4205-a599-0096541544f3 for instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 on hv-cinder-84457 Jun 03 12:15:27.351579 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-bc4173c1-c382-4417-8b95-f2fb8d20604d req-3ff40305-309e-455c-b261-329385a5b871 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Jun 03 12:15:27.352354 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 507/993] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:15:28.073329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:28.073945 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:28.080805 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:28.081314 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:28.082012 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:28.082446 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:28.114656 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:28.115204 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:28.115715 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lazy-loading 'fault' on Instance uuid 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:15:28.161567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:28.169112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0258a4db-c898-48be-ae1d-65082fc6c3f0 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 200 len: 1183 microversion: 2.1 time: 0.099632 Jun 03 12:15:28.169838 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 487/994] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:28 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 1183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:29.188325 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:29.189046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 9f6bed96-0a2e-4712-bbde-82b4e42da6e9] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:29.195799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:29.196305 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:29.197089 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:29.197527 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:29.211330 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] HTTP exception thrown: Instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 could not be found. Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Request method failure captured: Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 HTTP/1.1 Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimflPgSAfBosI_mqTbl22r9fgg03o38kGwqZkV7y_lWIr74QEMON6xgRYnSzzKpub6PLGy2XrLpL-k3CVtFbuTc4PqTFvEekyW0uWabk-jx4VKNeKeRcfPLzUWu-bYxyWyRX3vDRsHb9gRcMFh4b9tJN-hUbtBloUEWBi4KOt1TF9zhc Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:15:29.213083 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/adff32783b7a479d89e34cd1e5a118d6"}]}] Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 79c5b9ec7d2248918e884cd01adb84c6 Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 could not be found. Jun 03 12:15:29.214478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '9f6bed96-0a2e-4712-bbde-82b4e42da6e9'} Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 could not be found. Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:15:29.215862 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 could not be found. Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 could not be found. Jun 03 12:15:29.217172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:29.219276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Returning 404 to user: Instance 9f6bed96-0a2e-4712-bbde-82b4e42da6e9 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:15:29.219276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e537cfe7-2f85-4a63-868a-8644d6f567ad tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9" status: 404 len: 111 microversion: 2.1 time: 0.031488 Jun 03 12:15:29.219276 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 508/995] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:29 2022] GET /compute/v2.1/servers/9f6bed96-0a2e-4712-bbde-82b4e42da6e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:15:32.268409 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-87d01229-6a5b-4963-af4f-97b680d4fbf5 req-3e956710-ea35-4c39-b14e-25c57cf7badb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222f9db1-5f76-4953-9403-0570342e19af", "tag": "25d47bd3-2b7d-4bd9-8b2a-51978d9b195e"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:15:32.275654 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:32.276426 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:32.278958 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-87d01229-6a5b-4963-af4f-97b680d4fbf5 req-3e956710-ea35-4c39-b14e-25c57cf7badb service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:32.279821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-87d01229-6a5b-4963-af4f-97b680d4fbf5 req-3e956710-ea35-4c39-b14e-25c57cf7badb service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:32.282961 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:32.283469 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:32.284270 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:32.284707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:32.291852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-87d01229-6a5b-4963-af4f-97b680d4fbf5 req-3e956710-ea35-4c39-b14e-25c57cf7badb service nova] Creating event network-changed:25d47bd3-2b7d-4bd9-8b2a-51978d9b195e for instance 222f9db1-5f76-4953-9403-0570342e19af on hv-cinder-84457 Jun 03 12:15:32.297418 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-87d01229-6a5b-4963-af4f-97b680d4fbf5 req-3e956710-ea35-4c39-b14e-25c57cf7badb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032630 Jun 03 12:15:32.298208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 509/996] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:15:32.311146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:15:32.395722 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f7512345-5be1-4ca0-8325-f2589ad40cba tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "DELETE /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 204 len: 0 microversion: 2.1 time: 0.133291 Jun 03 12:15:32.399932 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 488/997] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:15:32 2022] DELETE /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:15:32.408177 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:32.410580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:32.417388 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:32.418086 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:32.419102 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:32.420395 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:32.583406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:32.591771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-1c23a22a-5fcd-4efe-a029-0210cf9fe8ea tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1578 microversion: 2.1 time: 0.189082 Jun 03 12:15:32.593200 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 510/998] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:32 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:33.612377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:33.613312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:33.620792 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:33.621276 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:33.622047 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:33.622478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:33.699194 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:33.707985 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5c586f9b-9f4e-4bbb-aaaf-1fa2d0775cfa tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1393 microversion: 2.1 time: 0.101568 Jun 03 12:15:33.708544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 489/999] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:33 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1393 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:33.794226 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-a3eb6359-648e-4a7d-ad96-12185e688c38 req-ecf73567-9352-4dc6-8d5e-2add06fea8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222f9db1-5f76-4953-9403-0570342e19af", "name": "network-vif-deleted", "tag": "25d47bd3-2b7d-4bd9-8b2a-51978d9b195e"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:15:33.803561 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-a3eb6359-648e-4a7d-ad96-12185e688c38 req-ecf73567-9352-4dc6-8d5e-2add06fea8d1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:33.804007 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-a3eb6359-648e-4a7d-ad96-12185e688c38 req-ecf73567-9352-4dc6-8d5e-2add06fea8d1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:33.816099 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-a3eb6359-648e-4a7d-ad96-12185e688c38 req-ecf73567-9352-4dc6-8d5e-2add06fea8d1 service nova] Creating event network-vif-deleted:25d47bd3-2b7d-4bd9-8b2a-51978d9b195e for instance 222f9db1-5f76-4953-9403-0570342e19af on hv-cinder-84457 Jun 03 12:15:33.821184 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-a3eb6359-648e-4a7d-ad96-12185e688c38 req-ecf73567-9352-4dc6-8d5e-2add06fea8d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030674 Jun 03 12:15:33.822082 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 511/1000] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:15:34.725262 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:34.725904 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:34.732333 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:34.732822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:34.733591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:34.734025 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:34.767773 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:34.768231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:34.768694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lazy-loading 'fault' on Instance uuid 222f9db1-5f76-4953-9403-0570342e19af {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:15:34.811276 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5b9ec7d2248918e884cd01adb84c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff32783b7a479d89e34cd1e5a118d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:15:34.818183 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f41ac77e-d805-4ed7-b141-4fd955bec1a1 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 200 len: 1185 microversion: 2.1 time: 0.097294 Jun 03 12:15:34.818729 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 490/1001] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:34 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:15:35.838190 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:35.838886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: 222f9db1-5f76-4953-9403-0570342e19af] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:35.845506 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:35.846636 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:35.847443 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:35.848027 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:35.862049 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] HTTP exception thrown: Instance 222f9db1-5f76-4953-9403-0570342e19af could not be found. Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Request method failure captured: Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af HTTP/1.1 Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimflPgSAfBosI_mqTbl22r9fgg03o38kGwqZkV7y_lWIr74QEMON6xgRYnSzzKpub6PLGy2XrLpL-k3CVtFbuTc4PqTFvEekyW0uWabk-jx4VKNeKeRcfPLzUWu-bYxyWyRX3vDRsHb9gRcMFh4b9tJN-hUbtBloUEWBi4KOt1TF9zhc Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:15:35.863685 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/adff32783b7a479d89e34cd1e5a118d6"}]}] Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 79c5b9ec7d2248918e884cd01adb84c6 Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 222f9db1-5f76-4953-9403-0570342e19af could not be found. Jun 03 12:15:35.865360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '222f9db1-5f76-4953-9403-0570342e19af'} Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222f9db1-5f76-4953-9403-0570342e19af could not be found. Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:15:35.866263 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222f9db1-5f76-4953-9403-0570342e19af could not be found. Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222f9db1-5f76-4953-9403-0570342e19af could not be found. Jun 03 12:15:35.867897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:35.869594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Returning 404 to user: Instance 222f9db1-5f76-4953-9403-0570342e19af could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:15:35.869594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-d9c437d6-edb0-4866-ae86-20d73f21604e tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af" status: 404 len: 111 microversion: 2.1 time: 0.032238 Jun 03 12:15:35.869594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 512/1002] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:35 2022] GET /compute/v2.1/servers/222f9db1-5f76-4953-9403-0570342e19af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 12:15:36.318999 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:36.319571 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:36.326042 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:36.326570 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:36.327449 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:36.327984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:36.342237 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] HTTP exception thrown: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Request method failure captured: Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 HTTP/1.1 Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimflPgSAfBosI_mqTbl22r9fgg03o38kGwqZkV7y_lWIr74QEMON6xgRYnSzzKpub6PLGy2XrLpL-k3CVtFbuTc4PqTFvEekyW0uWabk-jx4VKNeKeRcfPLzUWu-bYxyWyRX3vDRsHb9gRcMFh4b9tJN-hUbtBloUEWBi4KOt1TF9zhc Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:15:36.343948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/adff32783b7a479d89e34cd1e5a118d6"}]}] Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 79c5b9ec7d2248918e884cd01adb84c6 Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.345595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'e54e6c04-b883-43f5-b6d8-8ab782570d09'} Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:15:36.347057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.348587 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.350094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Returning 404 to user: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:15:36.350094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c89c8d24-f153-40e6-9d7c-8e12e1170892 tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 404 len: 111 microversion: 2.1 time: 0.031714 Jun 03 12:15:36.350094 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 491/1003] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:15:36 2022] DELETE /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:15:36.354930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:36.355703 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] [instance: e54e6c04-b883-43f5-b6d8-8ab782570d09] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:15:36.362344 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:36.362795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:36.363580 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:15:36.364020 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:15:36.378048 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] HTTP exception thrown: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Request method failure captured: Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 HTTP/1.1 Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimflPgSAfBosI_mqTbl22r9fgg03o38kGwqZkV7y_lWIr74QEMON6xgRYnSzzKpub6PLGy2XrLpL-k3CVtFbuTc4PqTFvEekyW0uWabk-jx4VKNeKeRcfPLzUWu-bYxyWyRX3vDRsHb9gRcMFh4b9tJN-hUbtBloUEWBi4KOt1TF9zhc Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:15:36.379628 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/adff32783b7a479d89e34cd1e5a118d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/adff32783b7a479d89e34cd1e5a118d6"}]}] Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: adff32783b7a479d89e34cd1e5a118d6 Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-TestVolumeBootPattern-996662452 Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 79c5b9ec7d2248918e884cd01adb84c6 Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-TestVolumeBootPattern-996662452-project Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.381259 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'e54e6c04-b883-43f5-b6d8-8ab782570d09'} Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:15:36.382222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. Jun 03 12:15:36.383864 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:15:36.385389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Returning 404 to user: Instance e54e6c04-b883-43f5-b6d8-8ab782570d09 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:15:36.385389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9817fd22-5869-450f-9d2b-484ecd6dd8ed tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09" status: 404 len: 111 microversion: 2.1 time: 0.030028 Jun 03 12:15:36.385389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 513/1004] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:15:36 2022] GET /compute/v2.1/servers/e54e6c04-b883-43f5-b6d8-8ab782570d09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:15:37.671782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-41f2d349-50d0-4b0f-a945-0492c1c5c72a tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] Calling method '.version_select at 0x7f19c637d040>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:15:37.692970 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-41f2d349-50d0-4b0f-a945-0492c1c5c72a tempest-TestVolumeBootPattern-996662452 tempest-TestVolumeBootPattern-996662452-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1917680760" status: 202 len: 0 microversion: 2.1 time: 0.025002 Jun 03 12:15:37.693604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 492/1005] 10.222.0.15 () {58 vars in 1262 bytes} [Fri Jun 3 12:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1917680760 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:16:00.173426 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:00.173969 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:00.176135 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=20 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:00.176764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=32 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:00.182599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:00.183039 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:00.183808 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:00.184235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:00.207365 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cc14ce87-10be-4730-a5ba-8d239688a800 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/ips" status: 200 len: 148 microversion: 2.1 time: 0.038096 Jun 03 12:16:00.207947 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 514/1006] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:16:00 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:01.529424 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16c00e57-a206-4933-9fcf-46824a047757"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:16:01.530480 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:01.532811 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:01.533443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:01.540822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:01.541271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:01.542065 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:01.542501 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:01.798758 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3145e2fa-ff5c-4074-b61f-48039367a612 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "POST /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274092 Jun 03 12:16:01.799356 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 493/1007] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:16:01 2022] POST /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:09.366112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:09.366643 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:09.373188 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:09.373626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:09.374373 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:09.374800 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:09.455914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lazy-loading 'services' on Instance uuid 25fd0ff2-7313-466f-837c-0f69348179d2 {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:16:09.526451 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-dc339904-ac08-4020-9293-f91b1318ca0c tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments/16c00e57-a206-4933-9fcf-46824a047757" status: 202 len: 0 microversion: 2.1 time: 0.163608 Jun 03 12:16:09.527046 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 515/1008] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:16:09 2022] DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments/16c00e57-a206-4933-9fcf-46824a047757 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:16:09.536807 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:09.537872 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:09.545326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:09.545822 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:09.546600 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:09.547082 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:09.576298 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-65a15c94-b93d-408d-af40-4257023b35bd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Jun 03 12:16:09.576856 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 494/1009] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:16:09 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:16:10.588594 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:10.589611 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:10.596461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:10.596914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:10.597671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:10.598116 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:10.627027 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-bb141c6a-3900-4873-abd8-7d1434a075f1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042801 Jun 03 12:16:10.627596 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 516/1010] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:16:10 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:16:10.683719 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:10.684347 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:10.690667 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:10.691115 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:10.691907 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:10.692344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:10.716626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:16:10.792889 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1ae3765c-20cd-4ce5-bee1-546acd5a84ef tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 204 len: 0 microversion: 2.1 time: 0.112736 Jun 03 12:16:10.793584 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 495/1011] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:16:10 2022] DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:16:10.802478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:10.803087 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:10.809029 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:10.809583 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:10.810387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:10.810807 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:10.939564 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:16:10.946964 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a585f910-7e1c-4180-ae4d-376493157bcd tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1677 microversion: 2.1 time: 0.148335 Jun 03 12:16:10.947590 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 517/1012] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:10 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:16:11.964290 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:11.964984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:11.971530 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:11.971980 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:11.972732 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:11.973162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:12.100984 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:16:12.108915 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3289e287-e699-47ab-9590-8eaacca094ec tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1677 microversion: 2.1 time: 0.148912 Jun 03 12:16:12.109498 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 496/1013] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:11 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:16:13.126446 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:13.127061 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:13.133691 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:13.134233 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:13.135004 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:13.135440 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:13.265411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c93102a757d4a2cbf7f515c4b67db2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f92333085e341938aaf258c0921cd5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:16:13.273525 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c16541a4-1381-4428-a125-5049d367a280 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 200 len: 1677 microversion: 2.1 time: 0.151656 Jun 03 12:16:13.274136 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 518/1014] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:13 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:16:13.635484 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-bd63efa2-6a0f-4135-a46e-b70d96f56499 req-2275da8a-e90e-4468-8109-a1c8f76bd567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fd0ff2-7313-466f-837c-0f69348179d2", "name": "network-vif-deleted", "tag": "2c34ff56-2711-40f0-943d-862eb54fcfd9"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:16:13.646186 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bd63efa2-6a0f-4135-a46e-b70d96f56499 req-2275da8a-e90e-4468-8109-a1c8f76bd567 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:13.647299 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bd63efa2-6a0f-4135-a46e-b70d96f56499 req-2275da8a-e90e-4468-8109-a1c8f76bd567 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:13.663251 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-bd63efa2-6a0f-4135-a46e-b70d96f56499 req-2275da8a-e90e-4468-8109-a1c8f76bd567 service nova] Creating event network-vif-deleted:2c34ff56-2711-40f0-943d-862eb54fcfd9 for instance 25fd0ff2-7313-466f-837c-0f69348179d2 on hv-cinder-84457 Jun 03 12:16:13.668976 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-bd63efa2-6a0f-4135-a46e-b70d96f56499 req-2275da8a-e90e-4468-8109-a1c8f76bd567 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037571 Jun 03 12:16:13.672312 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 497/1015] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:14.290121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:14.290729 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:14.297444 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:14.297896 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:14.298668 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:14.299099 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:14.312964 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 HTTP/1.1 Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:16:14.314621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:14.316411 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '25fd0ff2-7313-466f-837c-0f69348179d2'} Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:14.317334 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:14.319073 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:14.320949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:14.320949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-acb77dab-0ce1-4b80-a807-8e0fd8e0cd38 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 404 len: 111 microversion: 2.1 time: 0.029850 Jun 03 12:16:14.320949 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 519/1016] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:14 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:14.326894 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-474e9efd-4595-465e-9388-5b38acffbf90 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '.version_select at 0x7f19c5ab2d30>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:14.345255 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-474e9efd-4595-465e-9388-5b38acffbf90 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-649605335" status: 202 len: 0 microversion: 2.1 time: 0.023173 Jun 03 12:16:14.345934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 498/1017] 10.222.0.15 () {58 vars in 1217 bytes} [Fri Jun 3 12:16:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-649605335 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:16:16.086476 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:16.086978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:16.094019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:16.094466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:16.095222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:16.095694 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:16.111081 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 HTTP/1.1 Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:16:16.112648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.114333 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '25fd0ff2-7313-466f-837c-0f69348179d2'} Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:16.115335 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.116621 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.118056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:16.118056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8b5bad4e-e43e-4d07-bf7f-65a614cdb5d3 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 404 len: 111 microversion: 2.1 time: 0.031564 Jun 03 12:16:16.118056 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 520/1018] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:16:16 2022] DELETE /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:16.123199 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:16.123953 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 25fd0ff2-7313-466f-837c-0f69348179d2] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:16.130034 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:16.130477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:16.131232 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:16.131723 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:16.144574 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 HTTP/1.1 Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:16:16.146150 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.147734 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '25fd0ff2-7313-466f-837c-0f69348179d2'} Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:16.148940 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. Jun 03 12:16:16.150443 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:16.152360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance 25fd0ff2-7313-466f-837c-0f69348179d2 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:16.152360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-edca4908-4657-43d1-97b1-129ab051f5fe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2" status: 404 len: 111 microversion: 2.1 time: 0.028702 Jun 03 12:16:16.152360 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 499/1019] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:16 2022] GET /compute/v2.1/servers/25fd0ff2-7313-466f-837c-0f69348179d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:17.278049 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:17.278585 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:17.285179 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.285631 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.286396 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.286833 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.301783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 HTTP/1.1 Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:16:17.303349 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.305023 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '53a78daf-c3d9-4d83-9c4d-3a4e184d45f3'} Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:17.306093 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.307632 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.309532 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:17.309532 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-56b68955-a999-4174-af01-3434e95cbbfe tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 404 len: 111 microversion: 2.1 time: 0.030996 Jun 03 12:16:17.309532 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 521/1020] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:16:17 2022] DELETE /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:17.313545 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:17.314153 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:17.321707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.322177 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.322923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.323354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.337376 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 HTTP/1.1 Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:16:17.338893 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.340516 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '53a78daf-c3d9-4d83-9c4d-3a4e184d45f3'} Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:17.341478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. Jun 03 12:16:17.343138 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.344942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance 53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:17.344942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a402236f-84ad-4f9f-9a08-0f018217d5e1 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3" status: 404 len: 111 microversion: 2.1 time: 0.031093 Jun 03 12:16:17.344942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 500/1021] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:17 2022] GET /compute/v2.1/servers/53a78daf-c3d9-4d83-9c4d-3a4e184d45f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:17.348962 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:17.349458 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:17.355801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.356248 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.357006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.358012 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.371831 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f HTTP/1.1 Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:16:17.373352 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.375715 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'd1394f44-138a-4b23-b949-b6537e47c60f'} Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:17.376810 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.378303 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.379866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:17.379866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-21a0dcda-a08e-438d-9097-7f5120013a3e tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 404 len: 111 microversion: 2.1 time: 0.030254 Jun 03 12:16:17.379866 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 522/1022] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:16:17 2022] DELETE /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 12:16:17.383819 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:17.384425 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: d1394f44-138a-4b23-b949-b6537e47c60f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:17.391214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.391699 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.392456 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:17.392887 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:17.409209 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f HTTP/1.1 Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:16:17.410854 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.412578 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'd1394f44-138a-4b23-b949-b6537e47c60f'} Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:17.413730 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. Jun 03 12:16:17.415279 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:17.416782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance d1394f44-138a-4b23-b949-b6537e47c60f could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:17.416782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5090e540-db85-4586-abd4-b34ebf2ce3d6 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f" status: 404 len: 111 microversion: 2.1 time: 0.032257 Jun 03 12:16:17.416782 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 501/1023] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:17 2022] GET /compute/v2.1/servers/d1394f44-138a-4b23-b949-b6537e47c60f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:18.548368 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:18.548850 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:18.555289 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:18.555770 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:18.556523 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:18.556954 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:18.570937 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df HTTP/1.1 Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:16:18.572500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.573928 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': 'ccbc147a-97ca-458c-b45e-1df8bdf916df'} Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:18.574771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.576389 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.578037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:18.578037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-78f3f656-7e9b-4c89-9e3d-a608f039bafa tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 404 len: 111 microversion: 2.1 time: 0.029823 Jun 03 12:16:18.578037 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 523/1024] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:16:18 2022] DELETE /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:18.582164 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:18.582773 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] [instance: ccbc147a-97ca-458c-b45e-1df8bdf916df] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:16:18.589187 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:18.589635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:18.590390 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:16:18.590826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:16:18.603959 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] HTTP exception thrown: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Request method failure captured: Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df HTTP/1.1 Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.15 Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABimfmRjgXAYimcevoi40b9zvni6YKTJjLYbKrmF_7u_RtKFL-ESgf7wfT0iAvXb-BwkdGgPASXstrBw0AH5xpTIPQx5n_gwLH-523G-HSXXWsru0fZ4gSC5lJ0HiAVAaTUDbVFhiJpPfFdv8-lV1z3YO_tzvXi-Q8EgJuhxmJ-OHSDohQ Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 03 12:16:18.605447 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6f92333085e341938aaf258c0921cd5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6f92333085e341938aaf258c0921cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6f92333085e341938aaf258c0921cd5c"}]}] Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6f92333085e341938aaf258c0921cd5c Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1480246990 Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Id: 0c93102a757d4a2cbf7f515c4b67db2c Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1480246990-project Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: method: > Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: exception: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.607023 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'ccbc147a-97ca-458c-b45e-1df8bdf916df'} Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:18.608130 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. Jun 03 12:16:18.610134 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 03 12:16:18.611554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] Returning 404 to user: Instance ccbc147a-97ca-458c-b45e-1df8bdf916df could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:18.611554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7cd73da5-7be4-49dd-bce3-64c610a63168 tempest-AttachVolumeNegativeTest-1480246990 tempest-AttachVolumeNegativeTest-1480246990-project] 10.222.0.15 "GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df" status: 404 len: 111 microversion: 2.1 time: 0.028415 Jun 03 12:16:18.611554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 502/1025] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:16:18 2022] GET /compute/v2.1/servers/ccbc147a-97ca-458c-b45e-1df8bdf916df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:22.893602 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-afd5fb42-c607-4c43-b8ff-9667806ff1ee tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Action: 'create', calling method: .version_select at 0x7f19c59a69d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1538292367", "metadata": {"Type": "work"}}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:16:23.181142 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-afd5fb42-c607-4c43-b8ff-9667806ff1ee tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.406541 Jun 03 12:16:23.181897 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 524/1026] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Jun 3 12:16:22 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 12:16:23.193918 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-730cff26-40c1-4104-977b-b48ecf230978 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Calling method '.version_select at 0x7f19c5ab23a0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:23.246690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-730cff26-40c1-4104-977b-b48ecf230978 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39" status: 200 len: 353 microversion: 2.1 time: 0.056685 Jun 03 12:16:23.247257 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 503/1027] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:23 2022] GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:24.260406 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-685f390f-abd6-4a8e-a5af-e480b03f34b7 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Calling method '.version_select at 0x7f19c5be4ca0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:24.307340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-685f390f-abd6-4a8e-a5af-e480b03f34b7 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39" status: 200 len: 354 microversion: 2.1 time: 0.051319 Jun 03 12:16:24.307929 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 525/1028] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:24 2022] GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:24.320219 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7c799f9b-c5e8-4be2-94b4-e9b146a0c01a tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Calling method '.version_select at 0x7f19c63fa5e0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:24.371120 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7c799f9b-c5e8-4be2-94b4-e9b146a0c01a tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39" status: 200 len: 354 microversion: 2.1 time: 0.055556 Jun 03 12:16:24.371825 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 504/1029] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:24 2022] GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:24.383612 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-8c6893ff-0e34-46af-9d91-6819e364b40f tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Calling method '.version_select at 0x7f19c5b6d310>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:24.443463 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-8c6893ff-0e34-46af-9d91-6819e364b40f tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39" status: 202 len: 0 microversion: 2.1 time: 0.063592 Jun 03 12:16:24.444053 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 526/1030] 10.222.0.15 () {58 vars in 1247 bytes} [Fri Jun 3 12:16:24 2022] DELETE /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:16:24.459180 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-478b4c8e-2a97-49ad-a2dc-aef88954b77a tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Calling method '.version_select at 0x7f19c640dd30>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:24.505775 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-478b4c8e-2a97-49ad-a2dc-aef88954b77a tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39" status: 200 len: 353 microversion: 2.1 time: 0.050521 Jun 03 12:16:24.506329 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 505/1031] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:24 2022] GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:25.519105 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-389c097b-3bd9-4f9d-8a6b-077b6b47fdb9 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Calling method '.version_select at 0x7f19c5e4b160>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:25.546778 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-389c097b-3bd9-4f9d-8a6b-077b6b47fdb9 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] HTTP exception thrown: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-389c097b-3bd9-4f9d-8a6b-077b6b47fdb9 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Request method failure captured: Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 HTTP/1.1 Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfuWDcPOcwVU6GiW9-9BFDxbgehUiu9mjQABnxQoizsSwmMSR40pAzjZea0w0wLmvZdsqqtIOZCFi02LUH01VMWMGk6Rke9k_MJ_HEKG6Sa9xW43w3JjZ6CdlVokkbX3uafn9hcjCPR2oKJjo1jwYVj93W895KVh86Qs_YK-kVCIuNM Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: bdfe285d8d5443ddbf4547fcb631fe2a Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-VolumesGetTestJSON-367641744 Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:16:25.548783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bdfe285d8d5443ddbf4547fcb631fe2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bdfe285d8d5443ddbf4547fcb631fe2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bdfe285d8d5443ddbf4547fcb631fe2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bdfe285d8d5443ddbf4547fcb631fe2a"}]}] Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-VolumesGetTestJSON-367641744 Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: bdfe285d8d5443ddbf4547fcb631fe2a Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-VolumesGetTestJSON-367641744 Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-VolumesGetTestJSON-367641744-project Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: c8890978acc946539b3e339f46980ba5 Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-VolumesGetTestJSON-367641744-project Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '8f0e27e3-63cc-4bd3-9889-b35078bdce39'} Jun 03 12:16:25.551159 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. (HTTP 404) (Request-ID: req-9bc5c6ff-80b0-447f-b4e9-4d2b920564d5) Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:25.552657 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 12:16:25.554829 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 12:16:25.557014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-389c097b-3bd9-4f9d-8a6b-077b6b47fdb9 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] Returning 404 to user: Volume 8f0e27e3-63cc-4bd3-9889-b35078bdce39 could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-389c097b-3bd9-4f9d-8a6b-077b6b47fdb9 tempest-VolumesGetTestJSON-367641744 tempest-VolumesGetTestJSON-367641744-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39" status: 404 len: 109 microversion: 2.1 time: 0.035978 Jun 03 12:16:25.559913 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 527/1032] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:25 2022] GET /compute/v2.1/os-volumes/8f0e27e3-63cc-4bd3-9889-b35078bdce39 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:16:28.312624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-34b5b421-b4bb-45ab-9689-7587d3283950 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c5a10940>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:28.359106 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-34b5b421-b4bb-45ab-9689-7587d3283950 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/76c45b6f-406a-4cd9-bd93-c098cb02e87c" status: 200 len: 350 microversion: 2.1 time: 0.050691 Jun 03 12:16:28.359982 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 506/1033] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:28 2022] GET /compute/v2.1/os-volumes/76c45b6f-406a-4cd9-bd93-c098cb02e87c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:16:29.686597 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=20 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:29.687364 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:29.692121 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-312eadf8-9f7b-4981-b2d9-a41ed0b59fe2 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c784ee50>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:29.740690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-312eadf8-9f7b-4981-b2d9-a41ed0b59fe2 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/213691bf-9938-4b1a-8f87-e835ebabf3ba" status: 200 len: 350 microversion: 2.1 time: 0.055343 Jun 03 12:16:29.741247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 528/1034] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:29 2022] GET /compute/v2.1/os-volumes/213691bf-9938-4b1a-8f87-e835ebabf3ba => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:16:31.072218 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:31.073212 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:31.078405 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2defb1f7-4b36-46b8-8a69-8bcfcfa140f8 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c6416c10>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.128932 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2defb1f7-4b36-46b8-8a69-8bcfcfa140f8 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5e87109d-d27c-4498-be8e-d4b9728f2396" status: 200 len: 351 microversion: 2.1 time: 0.057499 Jun 03 12:16:31.129660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 507/1035] 10.222.0.15 () {58 vars in 1244 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes/5e87109d-d27c-4498-be8e-d4b9728f2396 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:31.141114 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-b6cc7fce-ee59-4ec7-a4ef-241b3a70396f tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c5cd5f70>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.221590 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-b6cc7fce-ee59-4ec7-a4ef-241b3a70396f tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084641 Jun 03 12:16:31.222166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 529/1036] 10.222.0.15 () {58 vars in 1133 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:16:31.235059 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4f82b8bf-e33c-4ee1-8e33-bcfe87c75eb9 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c63fa4c0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.320055 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4f82b8bf-e33c-4ee1-8e33-bcfe87c75eb9 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089281 Jun 03 12:16:31.320684 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 508/1037] 10.222.0.15 () {58 vars in 1148 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:31.332889 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ef794555-e539-455e-b113-dd95d321e156 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c59a65e0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.414431 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ef794555-e539-455e-b113-dd95d321e156 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085274 Jun 03 12:16:31.414993 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 530/1038] 10.222.0.15 () {58 vars in 1133 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:16:31.426247 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-26971161-8eee-429e-a82b-5d7716387eee tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c636bb80>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.505246 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-26971161-8eee-429e-a82b-5d7716387eee tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082713 Jun 03 12:16:31.505823 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 509/1039] 10.222.0.15 () {58 vars in 1166 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:31.517946 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-7f7fec13-eea4-4f57-9cf0-27a96e0e0d1b tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c5bb0ca0>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.604646 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-7f7fec13-eea4-4f57-9cf0-27a96e0e0d1b tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090950 Jun 03 12:16:31.605207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 531/1040] 10.222.0.15 () {58 vars in 1169 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:31.617380 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5f037a37-99d3-40bd-964b-af6dc3f70777 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c5b56700>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.696946 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5f037a37-99d3-40bd-964b-af6dc3f70777 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083289 Jun 03 12:16:31.697595 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 510/1041] 10.222.0.15 () {58 vars in 1154 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:16:31.709399 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-3628a4d6-214b-4b7a-b025-75a6e9423182 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c5bb0040>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.789870 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-3628a4d6-214b-4b7a-b025-75a6e9423182 tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084171 Jun 03 12:16:31.790487 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 532/1042] 10.222.0.15 () {58 vars in 1187 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:16:31.802079 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fd2da51a-13eb-4331-82b7-ca2ef054026b tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] Calling method '.version_select at 0x7f19c63e9c10>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:16:31.885537 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fd2da51a-13eb-4331-82b7-ca2ef054026b tempest-VolumesTestJSON-1570849034 tempest-VolumesTestJSON-1570849034-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087078 Jun 03 12:16:31.886232 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 511/1043] 10.222.0.15 () {58 vars in 1154 bytes} [Fri Jun 3 12:16:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:17:02.127851 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:17:02.128432 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:17:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:17:51.181092 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f7146491-ec86-439c-b02a-c171b6fbc3ca tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Action: 'create', calling method: .version_select at 0x7f19c5be4280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1441746961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyhFrsJ3E2qpYbw9L8tOfMlBLZsRMg/dAVfnnEf2QrhjHoJKM91uR8WZ75CoYnpEaOwrKEnSaBFHIz4Rj+TJOGreJDdkkrOE9hCHQS+SjFxaYTQLh+wglze9zxKpkCKrw=="}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:17:51.195070 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f7146491-ec86-439c-b02a-c171b6fbc3ca tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Getting quotas for project 115a680fe4994f61b8328b7e4e266507. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:17:51.198817 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.quota [None req-f7146491-ec86-439c-b02a-c171b6fbc3ca tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Getting quotas for user 8269e583a4f043a59e34ebfbdb1661ec and project 115a680fe4994f61b8328b7e4e266507. Resources: {'key_pairs'} {{(pid=117617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:17:51.219775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f7146491-ec86-439c-b02a-c171b6fbc3ca tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044081 Jun 03 12:17:51.220341 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 533/1044] 10.222.0.15 () {60 vars in 1158 bytes} [Fri Jun 3 12:17:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:17:51.268240 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-837666302", "imageRef": "12f69b35-194e-491b-bc3b-0f26e976a213", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1441746961", "networks": [{"uuid": "3ab60935-f761-43bc-9ccf-aef2bd3fab70"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:17:51.316923 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] validate_networks() for [('3ab60935-f761-43bc-9ccf-aef2bd3fab70', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 12:17:51.764645 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 12:17:51.765067 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 12:17:51.765540 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 12:17:51.765948 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 12:17:51.766357 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 12:17:51.775886 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:51.776331 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:51.777377 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:51.777812 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:51.794710 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Getting quotas for project 115a680fe4994f61b8328b7e4e266507. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 12:17:51.798603 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Getting quotas for user 8269e583a4f043a59e34ebfbdb1661ec and project 115a680fe4994f61b8328b7e4e266507. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 12:17:51.809396 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 12:17:51.811478 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12f69b35-194e-491b-bc3b-0f26e976a213',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 12:17:51.857132 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-174a930f-3ecd-420b-9334-884eb672bd45 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594496 Jun 03 12:17:51.857772 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 512/1045] 10.222.0.15 () {60 vars in 1146 bytes} [Fri Jun 3 12:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 12:17:51.867530 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-30145725-55e3-4f9d-af69-70e13adbb4e4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:51.868165 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-30145725-55e3-4f9d-af69-70e13adbb4e4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:51.921771 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-30145725-55e3-4f9d-af69-70e13adbb4e4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:51.928519 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-30145725-55e3-4f9d-af69-70e13adbb4e4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1258 microversion: 2.1 time: 0.064843 Jun 03 12:17:51.929247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 534/1046] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:51 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:17:52.946694 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:52.947849 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:52.959971 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:52.960781 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:52.961793 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:52.962353 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:53.038741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:53.048683 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2d292b7f-bf04-48b8-9252-8a6f0360cf17 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1318 microversion: 2.1 time: 0.106794 Jun 03 12:17:53.061741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 513/1047] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:52 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:17:54.072836 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:54.074793 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:54.086524 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:54.087745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:54.089241 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:54.090214 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:54.261076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:54.274144 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2b3048cc-932c-4a5d-abd8-c7244a206df4 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.208642 Jun 03 12:17:54.274985 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 535/1048] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:54 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:17:55.292626 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:55.293391 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:55.302368 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:55.302814 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:55.303715 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:55.304068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:55.437932 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:55.452057 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-329ea350-42b5-4827-8b0b-a6534b8a394c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.158597 Jun 03 12:17:55.452910 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 514/1049] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:55 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:17:56.468865 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:56.469542 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:56.476832 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:56.477281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:56.478055 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:56.478500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:56.630673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:56.639514 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c02cb2ca-f418-4b49-acdb-1e9676ad96b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.174583 Jun 03 12:17:56.640557 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 536/1050] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:56 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:17:57.657679 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:57.658304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:57.665761 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:57.666214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:57.667019 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:57.667455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:57.834135 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:57.846526 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ab5eabd8-0923-4226-b0ab-0243e286c3f8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.192658 Jun 03 12:17:57.847321 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 515/1051] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:57 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:17:58.865917 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:17:58.867442 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:17:58.874508 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:58.875274 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:58.876655 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:17:58.877442 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:17:59.020785 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:17:59.030118 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0c24a55a-737c-475f-b624-ea25d12e9680 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.169304 Jun 03 12:17:59.030707 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 537/1052] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:17:58 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:00.048538 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:00.051062 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:00.058751 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:00.059197 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:00.060005 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:00.060631 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:00.201479 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:00.210119 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-129996f3-17de-479f-b6bf-ac85b9fd4ac2 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.166191 Jun 03 12:18:00.220238 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 516/1053] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:00 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:01.228765 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:01.229374 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:01.235826 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:01.236277 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:01.237626 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:01.238064 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:01.361551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:01.369871 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-414475e7-34e7-42d1-8f6b-bd20edbf44c8 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.145072 Jun 03 12:18:01.370500 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 538/1054] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:01 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:02.388942 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:02.389567 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:02.391833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:02.392477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:02.398791 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:02.399258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:02.400037 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:02.400468 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:02.526068 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:02.534472 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2884af8d-b09d-45c0-9450-4a1f017f5378 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.149348 Jun 03 12:18:02.535344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 517/1055] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:02 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:03.551707 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:03.552234 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:03.554072 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=6 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:03.559666 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:03.560106 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:03.560875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:03.561306 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:03.686137 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:03.693999 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-0abbd2b4-77fa-4cf7-8768-5c89ce9c9297 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.146666 Jun 03 12:18:03.694545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 539/1056] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:03 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:04.501826 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-f884848c-6f6a-4148-8dc6-a44d030f44fb req-84b01210-0691-49dc-8596-9d905144277c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:18:04.531432 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-f884848c-6f6a-4148-8dc6-a44d030f44fb req-84b01210-0691-49dc-8596-9d905144277c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:04.531849 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-f884848c-6f6a-4148-8dc6-a44d030f44fb req-84b01210-0691-49dc-8596-9d905144277c service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:04.545156 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-f884848c-6f6a-4148-8dc6-a44d030f44fb req-84b01210-0691-49dc-8596-9d905144277c service nova] Creating event network-changed:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:18:04.550515 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-f884848c-6f6a-4148-8dc6-a44d030f44fb req-84b01210-0691-49dc-8596-9d905144277c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053642 Jun 03 12:18:04.551146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 518/1057] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:18:04.710875 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:04.711490 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:04.717924 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:04.718369 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:04.719131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:04.719599 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:04.854167 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:04.861736 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cf1693a2-7123-4ad0-80b0-07cfa6d7c5c5 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.155485 Jun 03 12:18:04.862281 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 540/1058] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:04 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:05.880896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:05.881660 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:05.888620 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:05.889063 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:05.889814 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:05.890254 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:06.022463 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:06.030083 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-afbb3b02-4cb2-47bf-b22a-c2fd98e3d616 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.153795 Jun 03 12:18:06.030639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 519/1059] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:05 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:07.047215 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:07.047843 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:07.054997 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:07.055438 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:07.056217 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:07.056648 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:07.182968 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:07.190330 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-e8bca6cb-6ab3-4f99-a377-4cffc36cef2f tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.147048 Jun 03 12:18:07.190880 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 541/1060] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:07 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:08.207589 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:08.208162 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:08.214555 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:08.215001 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:08.215817 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:08.216254 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:08.344635 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:08.351992 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-469dfd39-06db-476a-97b7-11dd43d69157 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.149003 Jun 03 12:18:08.352544 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 520/1061] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:08 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:09.368669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:09.369356 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:09.375868 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:09.376313 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:09.377065 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:09.377498 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:09.506661 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:09.514013 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4cd84842-315a-459c-b3c9-047fdf8e09bc tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.149330 Jun 03 12:18:09.514569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 542/1062] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:09 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:10.532898 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:10.533475 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:10.540554 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:10.540994 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:10.541741 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:10.542170 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:10.673272 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:10.681155 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1f291316-7a62-45eb-8f38-e31d307d64c0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.152762 Jun 03 12:18:10.681712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 521/1063] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:10 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:11.698213 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:11.698819 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:11.705350 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:11.705795 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:11.706556 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:11.706992 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:11.736864 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-6ac38eb5-57c2-4e13-bd42-90594053654c req-7de67419-9683-4984-92e8-1e8f382773e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "name": "network-vif-plugged", "status": "completed", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:18:11.746231 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-6ac38eb5-57c2-4e13-bd42-90594053654c req-7de67419-9683-4984-92e8-1e8f382773e1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:11.746833 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-6ac38eb5-57c2-4e13-bd42-90594053654c req-7de67419-9683-4984-92e8-1e8f382773e1 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:11.762388 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-6ac38eb5-57c2-4e13-bd42-90594053654c req-7de67419-9683-4984-92e8-1e8f382773e1 service nova] Creating event network-vif-plugged:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:18:11.767701 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-6ac38eb5-57c2-4e13-bd42-90594053654c req-7de67419-9683-4984-92e8-1e8f382773e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034515 Jun 03 12:18:11.768659 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 522/1064] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:18:11.844664 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:11.852207 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-c6bce889-8ed9-4d29-abc8-d14ad1a16727 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.157856 Jun 03 12:18:11.852773 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 543/1065] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:11 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:12.871176 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:12.871890 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:12.878036 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:12.878476 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:12.879434 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:12.879897 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:13.006901 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:13.014238 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e87f9882-3797-4449-a4f8-a826cd9b29bd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1358 microversion: 2.1 time: 0.148383 Jun 03 12:18:13.014787 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 523/1066] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:12 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:14.031799 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:14.032466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:14.039138 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.039607 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.040361 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.040790 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.169601 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:14.177075 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-59e9798c-b22c-4b45-b9e2-2b18bf2fa405 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1548 microversion: 2.1 time: 0.149321 Jun 03 12:18:14.177634 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 544/1067] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:14 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:14.192726 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:14.193374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:14.200203 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.200658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.201430 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.201868 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.564814 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:14.572745 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d7ae468b-ac12-47b6-94d4-e4b4a850b171 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1548 microversion: 2.1 time: 0.383840 Jun 03 12:18:14.573297 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 524/1068] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:14 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1548 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:14.589009 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:14.592559 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:14.593216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Searching by: {'deleted': False, 'project_id': '115a680fe4994f61b8328b7e4e266507'} {{(pid=117617) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 12:18:14.599775 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.600218 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.601006 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.601440 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.689584 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.multi_cell_list [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117617) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 12:18:14.780166 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4963484d-77d7-448f-9bec-1489da72be7b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.194805 Jun 03 12:18:14.780656 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 545/1069] 10.222.0.15 () {58 vars in 1124 bytes} [Fri Jun 3 12:18:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:18:14.790892 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:14.791518 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:14.797486 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.797926 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.798671 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:14.799101 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:14.927131 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:14.935250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7e498b6c-00f1-4577-b85b-aaaefaf417aa tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1548 microversion: 2.1 time: 0.148151 Jun 03 12:18:14.935858 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 525/1070] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:14 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:16.436569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40c135c1-1f1f-4c0b-a369-526ec4e6b332"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:18:16.437644 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:16.444640 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:16.445076 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:16.445822 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:16.446247 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:16.691471 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-5162db9e-40f6-4327-93ab-306b61e4880e tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258679 Jun 03 12:18:16.692100 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 546/1071] 10.222.0.15 () {60 vars in 1322 bytes} [Fri Jun 3 12:18:16 2022] POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:18:24.212748 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:24.213374 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:24.216662 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:24.220687 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:24.221135 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:24.221896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:24.222333 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:24.227010 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=73 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:24.352707 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:24.360806 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6c8cfdb5-2d93-44a9-931f-ea2599078dea tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1594 microversion: 2.1 time: 0.152680 Jun 03 12:18:24.361366 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 526/1072] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:24 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:25.994801 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell0:SELECT=2 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:25.999461 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-dd32c175-337a-4ab1-8979-e380513be2ea req-88bd44fb-d582-41c1-a111-69ebb0d9b76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:18:26.002930 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:26.009164 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-dd32c175-337a-4ab1-8979-e380513be2ea req-88bd44fb-d582-41c1-a111-69ebb0d9b76b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:26.009751 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-dd32c175-337a-4ab1-8979-e380513be2ea req-88bd44fb-d582-41c1-a111-69ebb0d9b76b service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:26.014325 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:26.024627 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-dd32c175-337a-4ab1-8979-e380513be2ea req-88bd44fb-d582-41c1-a111-69ebb0d9b76b service nova] Creating event network-changed:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:18:26.030658 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-dd32c175-337a-4ab1-8979-e380513be2ea req-88bd44fb-d582-41c1-a111-69ebb0d9b76b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037784 Jun 03 12:18:26.032033 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 547/1073] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:18:26.970041 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1879542713"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:18:26.970624 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:26.977303 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:26.977790 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:26.978611 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:26.979049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:27.124588 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.network.security_group_api [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Adding security group 4ac51974-3014-43dc-b492-071f200a7a5f to port bf23d26b-d7c8-4172-af4f-f1ae7627c41a Jun 03 12:18:27.506979 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f1aefa9a-dc41-4885-a920-7508a361f406 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.540945 Jun 03 12:18:27.508245 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 527/1074] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:18:26 2022] POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:18:27.522131 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:18:27.522840 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:18:27.531650 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:27.532537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:27.533309 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:27.534107 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:27.698288 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:18:27.706723 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-a0133aed-f9ea-4500-8791-5953ff1279bf tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1759 microversion: 2.1 time: 0.193061 Jun 03 12:18:27.707317 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 548/1075] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:18:27 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1759 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:18:28.047077 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-79b16b53-b277-41fe-9496-b18f63c89971 req-b0221d27-2643-4228-b6ae-79ed8ce4727f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:18:28.055351 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-79b16b53-b277-41fe-9496-b18f63c89971 req-b0221d27-2643-4228-b6ae-79ed8ce4727f service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:18:28.056547 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-79b16b53-b277-41fe-9496-b18f63c89971 req-b0221d27-2643-4228-b6ae-79ed8ce4727f service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:18:28.067899 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-79b16b53-b277-41fe-9496-b18f63c89971 req-b0221d27-2643-4228-b6ae-79ed8ce4727f service nova] Creating event network-changed:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:18:28.077049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-79b16b53-b277-41fe-9496-b18f63c89971 req-b0221d27-2643-4228-b6ae-79ed8ce4727f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033974 Jun 03 12:18:28.077644 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 528/1076] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:19:28.175534 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=3 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:28.176224 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=7 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:28.180182 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:19:28.181197 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:28.187948 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:28.188392 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:28.189128 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:28.189554 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:28.265324 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-2210b7bf-639e-49d8-b235-95b135df028d tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.090778 Jun 03 12:19:28.266110 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 549/1077] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:19:28 2022] POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:19:28.272911 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=5 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:28.273647 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=11 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:28.278393 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:28.279092 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:28.288744 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:28.289137 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:28.290491 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:28.290928 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:28.639249 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:28.647281 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bc218576-360e-4b3d-83cb-b09751ab6345 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1751 microversion: 2.1 time: 0.376423 Jun 03 12:19:28.651791 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 529/1078] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:28 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1751 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:29.665474 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:29.666168 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:29.672886 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:29.673360 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:29.674112 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:29.674541 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:29.868230 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:29.876660 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f166a6ab-d87a-4eff-96fb-997b9312cb49 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.215442 Jun 03 12:19:29.877218 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 550/1079] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:29 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:30.894639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:30.895409 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:30.901957 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:30.902657 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:30.903412 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:30.903868 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:31.046267 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:31.054146 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f24acaa8-ba75-4f63-b3f4-34d79e82731b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.163398 Jun 03 12:19:31.054690 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 530/1080] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:30 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:32.071039 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:32.071745 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:32.078169 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:32.078603 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:32.079346 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:32.079802 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:32.216340 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:32.225569 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-f0b4ca23-5b3f-4bd5-a819-7bae6fb7a8c7 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.158400 Jun 03 12:19:32.226132 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 551/1081] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:32 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:33.242081 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:33.242604 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:33.249049 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:33.249494 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:33.250250 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:33.250698 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:33.391442 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:33.399355 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-69e9e50f-e997-4bfd-be88-4eba1efc2c01 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.161263 Jun 03 12:19:33.399939 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 531/1082] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:33 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:34.417269 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:34.417874 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:34.425905 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:34.426347 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:34.427096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:34.427545 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:34.567208 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:34.575172 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-6232bc66-d4ef-464b-a1c0-560b156d95e9 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.162398 Jun 03 12:19:34.575753 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 552/1083] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:34 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:35.593006 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:35.593643 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:35.600151 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:35.600591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:35.601339 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:35.601770 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:35.739874 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:35.747846 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7bcc844e-8d95-4a5b-984b-6beed40aacc1 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.158703 Jun 03 12:19:35.748398 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 532/1084] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:35 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:36.765216 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:36.765821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:36.772344 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:36.772789 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:36.773546 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:36.773981 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:36.917923 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:36.926478 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-9e0f3ddf-3884-4295-9201-057de5987c75 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.165114 Jun 03 12:19:36.927036 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 553/1085] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:36 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:37.943888 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:37.944500 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:37.951113 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:37.951591 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:37.952354 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:37.952796 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:38.327862 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:38.336326 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aa3cff0e-59e6-4315-813b-9880dd35bffe tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.396444 Jun 03 12:19:38.336880 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 533/1086] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:37 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:39.353645 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:39.354283 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:39.361466 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:39.361914 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:39.362671 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:39.363101 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:39.500536 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:39.508452 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ba268cf1-0bb9-4183-a14c-7ba671b04c70 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1756 microversion: 2.1 time: 0.158630 Jun 03 12:19:39.509019 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 554/1087] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:39 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:19:40.525934 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:19:40.526492 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:19:40.533813 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:40.534258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:40.535018 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:19:40.535455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:19:40.675051 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:19:40.683031 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d24f8931-ce1e-495d-9ee6-4b7935b20af0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1759 microversion: 2.1 time: 0.161046 Jun 03 12:19:40.683610 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 534/1088] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:19:40 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:20:11.570759 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:20:11.571455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:20:16.817683 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:20:16.818306 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:20:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:20:22.136713 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:20:22.137387 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:20:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:20:43.962884 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_api:SELECT=12 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:43.963692 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG dbcounter [-] [117617] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:43.967966 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1879542713"}} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:20:43.968533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:43.975803 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:43.976326 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:43.977079 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:43.977512 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:44.108762 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.network.security_group_api [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Removing security group 4ac51974-3014-43dc-b492-071f200a7a5f from port bf23d26b-d7c8-4172-af4f-f1ae7627c41a Jun 03 12:20:44.497957 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-960408df-212d-4286-9997-7a1d5229c88c tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.536529 Jun 03 12:20:44.501764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 555/1089] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Jun 3 12:20:43 2022] POST /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:20:44.507460 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=12 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:44.508664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=36 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:44.606330 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-0b0cf6fc-637b-452d-955d-6c07ccc4e496 req-785b8e44-2fd8-4ba2-8071-a47bb59a1809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:20:44.616271 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-0b0cf6fc-637b-452d-955d-6c07ccc4e496 req-785b8e44-2fd8-4ba2-8071-a47bb59a1809 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:44.616688 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-0b0cf6fc-637b-452d-955d-6c07ccc4e496 req-785b8e44-2fd8-4ba2-8071-a47bb59a1809 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:44.631962 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-0b0cf6fc-637b-452d-955d-6c07ccc4e496 req-785b8e44-2fd8-4ba2-8071-a47bb59a1809 service nova] Creating event network-changed:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:20:44.638353 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-0b0cf6fc-637b-452d-955d-6c07ccc4e496 req-785b8e44-2fd8-4ba2-8071-a47bb59a1809 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132441 Jun 03 12:20:44.639477 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 535/1090] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:20:45.872192 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:45.872833 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:45.880669 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:45.881210 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:45.882050 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:45.882784 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:45.971690 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.objects.instance [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lazy-loading 'services' on Instance uuid 6d3904a5-2cc2-4570-a782-52908cba9ffb {{(pid=117617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 12:20:46.050838 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-35900e98-75e1-4e6b-8259-a9792380beb0 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments/40c135c1-1f1f-4c0b-a369-526ec4e6b332" status: 202 len: 0 microversion: 2.1 time: 0.183425 Jun 03 12:20:46.054553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 556/1091] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:20:45 2022] DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments/40c135c1-1f1f-4c0b-a369-526ec4e6b332 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:20:46.062664 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:46.064593 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:46.075824 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:46.076752 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:46.077680 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:46.078206 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:46.122258 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b9881488-712c-41b4-924c-7af666e38dbd tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065584 Jun 03 12:20:46.123343 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 536/1092] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:20:46 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:20:46.653764 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [req-785e4588-decb-41dd-9e34-5e4999f319ea req-0fd79652-c07b-49c9-a110-1cb2c7b88a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:20:46.670339 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-785e4588-decb-41dd-9e34-5e4999f319ea req-0fd79652-c07b-49c9-a110-1cb2c7b88a16 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:46.670777 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [req-785e4588-decb-41dd-9e34-5e4999f319ea req-0fd79652-c07b-49c9-a110-1cb2c7b88a16 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:46.683459 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.compute.server_external_events [req-785e4588-decb-41dd-9e34-5e4999f319ea req-0fd79652-c07b-49c9-a110-1cb2c7b88a16 service nova] Creating event network-changed:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:20:46.688765 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [req-785e4588-decb-41dd-9e34-5e4999f319ea req-0fd79652-c07b-49c9-a110-1cb2c7b88a16 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039035 Jun 03 12:20:46.689587 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 557/1093] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:20:47.134455 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:47.135390 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:47.141891 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:47.142342 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:47.143116 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:47.143579 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:47.173361 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ba8954e2-5f4b-42eb-bb9b-de6a8020c602 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042822 Jun 03 12:20:47.173912 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 537/1094] 10.222.0.15 () {58 vars in 1301 bytes} [Fri Jun 3 12:20:47 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 12:20:47.185069 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:47.185673 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:47.192336 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:47.192783 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:47.193537 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:47.193962 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:47.270852 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] HTTP exception thrown: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb is not attached to volume 40c135c1-1f1f-4c0b-a369-526ec4e6b332 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Request method failure captured: Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments/40c135c1-1f1f-4c0b-a369-526ec4e6b332 HTTP/1.1 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfvhI-4BpQ1VQ_7xYu6lpO7oyJCOFL89PwrzGenRDGrQqOOJoG_mCaMZ0l8nMUPt2YCfYjZTdyn2PvhQp9s5AzTQEqE3RuSgRH3MRmr1BzZmUyfbd5Z9VDAr27WgTKi3-5vTVxT8bd67-97seyS0_Fj9WuudZNSzgu3EQGi7i6BHmBc Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 115a680fe4994f61b8328b7e4e266507 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-TestMinimumBasicScenario-1489794314 Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:20:47.273260 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/115a680fe4994f61b8328b7e4e266507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_115a680fe4994f61b8328b7e4e266507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/115a680fe4994f61b8328b7e4e266507"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/115a680fe4994f61b8328b7e4e266507"}]}] Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-TestMinimumBasicScenario-1489794314 Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 115a680fe4994f61b8328b7e4e266507 Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1489794314 Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-TestMinimumBasicScenario-1489794314-project Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 8269e583a4f043a59e34ebfbdb1661ec Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-TestMinimumBasicScenario-1489794314-project Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:20:47.275147 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb is not attached to volume 40c135c1-1f1f-4c0b-a369-526ec4e6b332 Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'server_id': '6d3904a5-2cc2-4570-a782-52908cba9ffb', 'id': '40c135c1-1f1f-4c0b-a369-526ec4e6b332'} Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 40c135c1-1f1f-4c0b-a369-526ec4e6b332. Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:20:47.276205 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb is not attached to volume 40c135c1-1f1f-4c0b-a369-526ec4e6b332 Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb is not attached to volume 40c135c1-1f1f-4c0b-a369-526ec4e6b332 Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:47.278140 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Returning 404 to user: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb is not attached to volume 40c135c1-1f1f-4c0b-a369-526ec4e6b332 {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:20:47.279383 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-46815eb1-1b4b-48ba-b856-f9e6da8620b3 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments/40c135c1-1f1f-4c0b-a369-526ec4e6b332" status: 404 len: 154 microversion: 2.1 time: 0.094433 Jun 03 12:20:47.279383 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 558/1095] 10.222.0.15 () {58 vars in 1415 bytes} [Fri Jun 3 12:20:47 2022] DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb/os-volume_attachments/40c135c1-1f1f-4c0b-a369-526ec4e6b332 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:20:48.589147 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:48.589639 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:48.596222 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:48.596675 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:48.598304 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:48.598896 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:48.622821 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 12:20:48.697841 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-648c2db0-0a47-4c11-a55d-c12ac51615bb tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 204 len: 0 microversion: 2.1 time: 0.112375 Jun 03 12:20:48.698336 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 538/1096] 10.222.0.15 () {58 vars in 1238 bytes} [Fri Jun 3 12:20:48 2022] DELETE /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 12:20:48.707752 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:48.708468 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:48.715280 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:48.715786 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:48.716549 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:48.716978 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:48.842740 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:20:48.850202 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-ab41dcdb-c218-4193-a912-7d1f6a15e137 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1554 microversion: 2.1 time: 0.147345 Jun 03 12:20:48.850760 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 559/1097] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:20:48 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:20:49.868433 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:49.869160 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:49.875658 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:49.876112 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:49.876882 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:49.877306 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:50.009344 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:20:50.016742 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-778246db-2f01-40e8-a81f-0c7676240a19 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1554 microversion: 2.1 time: 0.152550 Jun 03 12:20:50.017300 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 539/1098] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:20:49 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:20:51.034297 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:51.035414 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:51.041781 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:51.042222 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:51.042972 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:51.043401 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:51.174417 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.policy [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8269e583a4f043a59e34ebfbdb1661ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115a680fe4994f61b8328b7e4e266507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117617) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 12:20:51.182553 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-4f3bce9b-dbae-4a69-8e0f-a9d008743547 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 200 len: 1554 microversion: 2.1 time: 0.152151 Jun 03 12:20:51.183198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 560/1099] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:20:51 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:20:51.368265 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-15c3f5cf-58ea-4c33-a787-43f7498bf868 req-02fe1605-d4d4-4c43-8f96-8400dd44b338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3904a5-2cc2-4570-a782-52908cba9ffb", "name": "network-vif-deleted", "tag": "bf23d26b-d7c8-4172-af4f-f1ae7627c41a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:20:51.376071 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-15c3f5cf-58ea-4c33-a787-43f7498bf868 req-02fe1605-d4d4-4c43-8f96-8400dd44b338 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:51.377012 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-15c3f5cf-58ea-4c33-a787-43f7498bf868 req-02fe1605-d4d4-4c43-8f96-8400dd44b338 service nova] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:51.387021 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-15c3f5cf-58ea-4c33-a787-43f7498bf868 req-02fe1605-d4d4-4c43-8f96-8400dd44b338 service nova] Creating event network-vif-deleted:bf23d26b-d7c8-4172-af4f-f1ae7627c41a for instance 6d3904a5-2cc2-4570-a782-52908cba9ffb on hv-cinder-84457 Jun 03 12:20:51.392712 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-15c3f5cf-58ea-4c33-a787-43f7498bf868 req-02fe1605-d4d4-4c43-8f96-8400dd44b338 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088120 Jun 03 12:20:51.393286 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 540/1100] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Jun 3 12:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:20:52.199533 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '>' {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:52.200096 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.compute.api [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] [instance: 6d3904a5-2cc2-4570-a782-52908cba9ffb] Fetching instance by UUID {{(pid=117617) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 12:20:52.206526 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:52.206973 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:52.207763 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:20:52.208198 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG oslo_concurrency.lockutils [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Lock "46990915-54e5-4344-a0d3-647f9a9390cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:20:52.221186 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.wsgi [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] HTTP exception thrown: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb could not be found. Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Request method failure captured: Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: request: GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb HTTP/1.1 Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept: application/json Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Accept-Encoding: identity Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Connection: close Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Length: 0 Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Content-Type: application/json Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Host: 10.222.0.15 Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Openstack-System-Scope: None Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: User-Agent: python-urllib3/1.26.9 Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Auth-Token: gAAAAABimfvhI-4BpQ1VQ_7xYu6lpO7oyJCOFL89PwrzGenRDGrQqOOJoG_mCaMZ0l8nMUPt2YCfYjZTdyn2PvhQp9s5AzTQEqE3RuSgRH3MRmr1BzZmUyfbd5Z9VDAr27WgTKi3-5vTVxT8bd67-97seyS0_Fj9WuudZNSzgu3EQGi7i6BHmBc Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Id: None Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Domain-Name: None Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Identity-Status: Confirmed Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Is-Admin-Project: True Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Id: default Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Domain-Name: Default Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Id: 115a680fe4994f61b8328b7e4e266507 Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Project-Name: tempest-TestMinimumBasicScenario-1489794314 Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Role: reader,member Jun 03 12:20:52.222675 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Roles: reader,member Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/115a680fe4994f61b8328b7e4e266507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_115a680fe4994f61b8328b7e4e266507"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/115a680fe4994f61b8328b7e4e266507"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/115a680fe4994f61b8328b7e4e266507"}]}] Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant: tempest-TestMinimumBasicScenario-1489794314 Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Id: 115a680fe4994f61b8328b7e4e266507 Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1489794314 Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User: tempest-TestMinimumBasicScenario-1489794314-project Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Id: default Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Domain-Name: Default Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Id: 8269e583a4f043a59e34ebfbdb1661ec Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: X-User-Name: tempest-TestMinimumBasicScenario-1489794314-project Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: method: > Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: exception: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb could not be found. Jun 03 12:20:52.224538 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: action_args: {'id': '6d3904a5-2cc2-4570-a782-52908cba9ffb'} Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: {{(pid=117617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb could not be found. Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:20:52.225551 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb could not be found. Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb could not be found. Jun 03 12:20:52.227235 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: ERROR nova.api.openstack.wsgi Jun 03 12:20:52.228821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: DEBUG nova.api.openstack.wsgi [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Returning 404 to user: Instance 6d3904a5-2cc2-4570-a782-52908cba9ffb could not be found. {{(pid=117617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:20:52.228821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO nova.api.openstack.requestlog [None req-cd0325a4-05f5-4fba-94a9-b79279cd6e9b tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb" status: 404 len: 111 microversion: 2.1 time: 0.028485 Jun 03 12:20:52.228821 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: [pid: 117617|app: 0|req: 561/1101] 10.222.0.15 () {58 vars in 1235 bytes} [Fri Jun 3 12:20:52 2022] GET /compute/v2.1/servers/6d3904a5-2cc2-4570-a782-52908cba9ffb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 12:20:52.233214 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2375d133-2d54-4a24-91e6-a752f1f16567 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] Calling method '.version_select at 0x7f19c64ded30>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:20:52.250542 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2375d133-2d54-4a24-91e6-a752f1f16567 tempest-TestMinimumBasicScenario-1489794314 tempest-TestMinimumBasicScenario-1489794314-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1441746961" status: 202 len: 0 microversion: 2.1 time: 0.021424 Jun 03 12:20:52.251081 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 541/1102] 10.222.0.15 () {58 vars in 1271 bytes} [Fri Jun 3 12:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1441746961 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 12:23:31.578922 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:23:31.579725 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:23:36.826571 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:23:36.827162 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:23:42.145014 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:23:42.145776 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:23:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:23:46.169994 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:23:46.170573 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:23:52.338385 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:23:52.338971 dv-cinder-844572-1-iscsi devstack@n-api.service[117617]: Fri Jun 3 12:23:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 12:23:59.029021 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 12:23:59.029572 dv-cinder-844572-1-iscsi devstack@n-api.service[117618]: Fri Jun 3 12:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!